2023-10-29 16:52:40,855 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-29 16:52:41,084 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775 2023-10-29 16:52:41,097 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-29 16:52:41,097 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255, deleteOnExit=true 2023-10-29 16:52:41,098 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-29 16:52:41,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/test.cache.data in system properties and HBase conf 2023-10-29 16:52:41,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/hadoop.tmp.dir in system properties and HBase conf 2023-10-29 16:52:41,105 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/hadoop.log.dir in system properties and HBase conf 2023-10-29 16:52:41,106 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-29 16:52:41,106 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-29 16:52:41,107 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-29 16:52:41,238 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-29 16:52:41,595 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-29 16:52:41,599 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-29 16:52:41,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-29 16:52:41,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-29 16:52:41,600 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 16:52:41,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-29 16:52:41,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-29 16:52:41,601 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 16:52:41,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 16:52:41,602 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-29 16:52:41,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/nfs.dump.dir in system properties and HBase conf 2023-10-29 16:52:41,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/java.io.tmpdir in system properties and HBase conf 2023-10-29 16:52:41,603 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 16:52:41,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-29 16:52:41,604 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-29 16:52:42,161 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 16:52:42,165 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 16:52:42,434 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-29 16:52:42,619 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-29 16:52:42,633 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 16:52:42,665 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 16:52:42,693 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/java.io.tmpdir/Jetty_localhost_45909_hdfs____fy9y17/webapp 2023-10-29 16:52:42,820 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45909 2023-10-29 16:52:42,828 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 16:52:42,828 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 16:52:43,304 WARN [Listener at localhost/42197] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 16:52:43,390 WARN [Listener at localhost/42197] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-29 16:52:43,409 WARN [Listener at localhost/42197] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 16:52:43,415 INFO [Listener at localhost/42197] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 16:52:43,420 INFO [Listener at localhost/42197] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/java.io.tmpdir/Jetty_localhost_42507_datanode____fwzoo5/webapp 2023-10-29 16:52:43,504 INFO [Listener at localhost/42197] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42507 2023-10-29 16:52:43,839 WARN [Listener at localhost/45209] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 16:52:44,312 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc086b0563777bb74: Processing first storage report for DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904 from datanode 4905a877-febc-47e0-bc06-2a942bdd6717 2023-10-29 16:52:44,314 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc086b0563777bb74: from storage DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904 node DatanodeRegistration(127.0.0.1:38025, datanodeUuid=4905a877-febc-47e0-bc06-2a942bdd6717, infoPort=37375, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1095734382;c=1698598362228), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-29 16:52:44,314 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc086b0563777bb74: Processing first storage report for DS-8e266002-14ad-4677-91bb-138a1fac800d from datanode 4905a877-febc-47e0-bc06-2a942bdd6717 2023-10-29 16:52:44,314 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc086b0563777bb74: from storage DS-8e266002-14ad-4677-91bb-138a1fac800d node DatanodeRegistration(127.0.0.1:38025, datanodeUuid=4905a877-febc-47e0-bc06-2a942bdd6717, infoPort=37375, infoSecurePort=0, ipcPort=45209, storageInfo=lv=-57;cid=testClusterID;nsid=1095734382;c=1698598362228), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-29 16:52:44,315 DEBUG [Listener at localhost/45209] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775 2023-10-29 16:52:44,385 INFO [Listener at localhost/45209] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/zookeeper_0, clientPort=61373, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-29 16:52:44,399 INFO [Listener at localhost/45209] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61373 2023-10-29 16:52:44,409 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:44,412 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:45,061 INFO [Listener at localhost/45209] util.FSUtils(471): Created version file at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613 with version=8 2023-10-29 16:52:45,061 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/hbase-staging 2023-10-29 16:52:45,324 INFO [Listener at localhost/45209] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-29 16:52:45,681 INFO [Listener at localhost/45209] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-10-29 16:52:45,707 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:45,707 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:45,707 INFO [Listener at localhost/45209] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 16:52:45,707 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:45,707 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 16:52:45,833 INFO [Listener at localhost/45209] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 16:52:45,909 DEBUG [Listener at localhost/45209] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-29 16:52:45,984 INFO [Listener at localhost/45209] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42601 2023-10-29 16:52:45,992 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:45,994 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:46,013 INFO [Listener at localhost/45209] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42601 connecting to ZooKeeper ensemble=127.0.0.1:61373 2023-10-29 16:52:46,046 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:426010x0, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 16:52:46,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42601-0x1017e9cf5f50000 connected 2023-10-29 16:52:46,072 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 16:52:46,073 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 16:52:46,078 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 16:52:46,086 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42601 2023-10-29 16:52:46,086 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42601 2023-10-29 16:52:46,086 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42601 2023-10-29 16:52:46,090 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42601 2023-10-29 16:52:46,095 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42601 2023-10-29 16:52:46,101 INFO [Listener at localhost/45209] master.HMaster(444): hbase.rootdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613, hbase.cluster.distributed=false 2023-10-29 16:52:46,174 INFO [Listener at localhost/45209] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-10-29 16:52:46,175 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:46,175 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:46,175 INFO [Listener at localhost/45209] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 16:52:46,175 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 16:52:46,176 INFO [Listener at localhost/45209] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 16:52:46,181 INFO [Listener at localhost/45209] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 16:52:46,191 INFO [Listener at localhost/45209] ipc.NettyRpcServer(120): Bind to /148.251.75.209:43165 2023-10-29 16:52:46,194 INFO [Listener at localhost/45209] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-29 16:52:46,202 DEBUG [Listener at localhost/45209] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-29 16:52:46,203 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:46,206 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:46,209 INFO [Listener at localhost/45209] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43165 connecting to ZooKeeper ensemble=127.0.0.1:61373 2023-10-29 16:52:46,213 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:431650x0, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 16:52:46,214 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43165-0x1017e9cf5f50001 connected 2023-10-29 16:52:46,214 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 16:52:46,216 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 16:52:46,216 DEBUG [Listener at localhost/45209] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 16:52:46,220 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43165 2023-10-29 16:52:46,220 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43165 2023-10-29 16:52:46,222 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43165 2023-10-29 16:52:46,223 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43165 2023-10-29 16:52:46,223 DEBUG [Listener at localhost/45209] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43165 2023-10-29 16:52:46,225 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:46,232 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 16:52:46,233 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:46,249 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 16:52:46,249 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 16:52:46,249 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:46,250 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 16:52:46,251 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,42601,1698598365195 from backup master directory 2023-10-29 16:52:46,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 16:52:46,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:46,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 16:52:46,255 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 16:52:46,255 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:46,258 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-29 16:52:46,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-29 16:52:46,335 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/hbase.id with ID: 0fe0695b-d33f-4373-84b3-f7192ffb50b2 2023-10-29 16:52:46,376 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:46,849 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:46,892 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x1ee921bf to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:47,121 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@110df5d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:47,145 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-29 16:52:47,146 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-29 16:52:47,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-29 16:52:47,161 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-29 16:52:47,163 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 16:52:47,167 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 16:52:47,168 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 16:52:47,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store-tmp 2023-10-29 16:52:47,627 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:47,627 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 16:52:47,628 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:52:47,628 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:52:47,628 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 16:52:47,628 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:52:47,628 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:52:47,628 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 16:52:47,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/WALs/jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:47,653 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42601%2C1698598365195, suffix=, logDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/WALs/jenkins-hbase20.apache.org,42601,1698598365195, archiveDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/oldWALs, maxLogs=10 2023-10-29 16:52:47,714 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK] 2023-10-29 16:52:47,721 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-29 16:52:47,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/WALs/jenkins-hbase20.apache.org,42601,1698598365195/jenkins-hbase20.apache.org%2C42601%2C1698598365195.1698598367663 2023-10-29 16:52:47,783 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK]] 2023-10-29 16:52:47,784 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:52:47,785 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:47,788 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,789 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,849 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,857 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-29 16:52:47,879 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-29 16:52:47,891 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:47,896 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,898 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 16:52:47,920 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:52:47,922 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66354655, jitterRate=-0.011238589882850647}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:52:47,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 16:52:47,924 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-29 16:52:47,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-29 16:52:47,943 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-29 16:52:47,946 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-29 16:52:47,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-29 16:52:47,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 34 msec 2023-10-29 16:52:47,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-29 16:52:48,011 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-29 16:52:48,017 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-29 16:52:48,041 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-29 16:52:48,044 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-29 16:52:48,047 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-29 16:52:48,053 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-29 16:52:48,057 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-29 16:52:48,059 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:48,060 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-29 16:52:48,061 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-29 16:52:48,076 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-29 16:52:48,080 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 16:52:48,080 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 16:52:48,081 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:48,081 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,42601,1698598365195, sessionid=0x1017e9cf5f50000, setting cluster-up flag (Was=false) 2023-10-29 16:52:48,095 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:48,098 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-29 16:52:48,100 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:48,114 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:48,118 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-29 16:52:48,120 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:48,122 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp 2023-10-29 16:52:48,128 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(951): ClusterId : 0fe0695b-d33f-4373-84b3-f7192ffb50b2 2023-10-29 16:52:48,133 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-29 16:52:48,138 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-29 16:52:48,139 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-29 16:52:48,142 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-29 16:52:48,144 DEBUG [RS:0;jenkins-hbase20:43165] zookeeper.ReadOnlyZKClient(139): Connect 0x749237b6 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:48,153 DEBUG [RS:0;jenkins-hbase20:43165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a55d754, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:48,153 DEBUG [RS:0;jenkins-hbase20:43165] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e6a5cc6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-29 16:52:48,177 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:43165 2023-10-29 16:52:48,180 INFO [RS:0;jenkins-hbase20:43165] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-29 16:52:48,180 INFO [RS:0;jenkins-hbase20:43165] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-29 16:52:48,180 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1022): About to register with Master. 2023-10-29 16:52:48,183 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,42601,1698598365195 with isa=jenkins-hbase20.apache.org/148.251.75.209:43165, startcode=1698598366173 2023-10-29 16:52:48,200 DEBUG [RS:0;jenkins-hbase20:43165] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-29 16:52:48,246 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-29 16:52:48,254 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50931, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-29 16:52:48,255 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 16:52:48,255 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 16:52:48,255 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 16:52:48,256 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 16:52:48,256 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-29 16:52:48,256 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,256 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-29 16:52:48,256 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,257 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698598398257 2023-10-29 16:52:48,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-29 16:52:48,264 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-29 16:52:48,264 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 16:52:48,265 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-29 16:52:48,270 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 16:52:48,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-29 16:52:48,277 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-29 16:52:48,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-29 16:52:48,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-29 16:52:48,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-29 16:52:48,282 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,287 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-29 16:52:48,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-29 16:52:48,289 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-29 16:52:48,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-29 16:52:48,297 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-29 16:52:48,297 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(2830): Master is not running yet 2023-10-29 16:52:48,298 WARN [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-29 16:52:48,299 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698598368299,5,FailOnTimeoutGroup] 2023-10-29 16:52:48,300 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698598368299,5,FailOnTimeoutGroup] 2023-10-29 16:52:48,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,300 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-29 16:52:48,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,302 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,309 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 16:52:48,310 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 16:52:48,310 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613 2023-10-29 16:52:48,325 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:48,328 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 16:52:48,331 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/info 2023-10-29 16:52:48,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 16:52:48,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,333 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 16:52:48,337 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/rep_barrier 2023-10-29 16:52:48,337 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 16:52:48,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,338 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 16:52:48,341 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/table 2023-10-29 16:52:48,341 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 16:52:48,342 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,344 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740 2023-10-29 16:52:48,345 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740 2023-10-29 16:52:48,350 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 16:52:48,352 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 16:52:48,358 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:52:48,359 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61338348, jitterRate=-0.085987389087677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 16:52:48,360 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 16:52:48,360 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 16:52:48,360 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 16:52:48,360 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 16:52:48,360 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 16:52:48,360 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 16:52:48,361 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 16:52:48,362 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 16:52:48,367 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 16:52:48,367 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-29 16:52:48,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-29 16:52:48,390 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-29 16:52:48,392 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-29 16:52:48,399 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,42601,1698598365195 with isa=jenkins-hbase20.apache.org/148.251.75.209:43165, startcode=1698598366173 2023-10-29 16:52:48,404 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,409 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613 2023-10-29 16:52:48,409 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42197 2023-10-29 16:52:48,409 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-29 16:52:48,414 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 16:52:48,415 DEBUG [RS:0;jenkins-hbase20:43165] zookeeper.ZKUtil(162): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,415 WARN [RS:0;jenkins-hbase20:43165] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 16:52:48,415 INFO [RS:0;jenkins-hbase20:43165] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 16:52:48,415 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,417 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,43165,1698598366173] 2023-10-29 16:52:48,425 DEBUG [RS:0;jenkins-hbase20:43165] zookeeper.ZKUtil(162): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,436 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-29 16:52:48,445 INFO [RS:0;jenkins-hbase20:43165] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-29 16:52:48,466 INFO [RS:0;jenkins-hbase20:43165] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-29 16:52:48,471 INFO [RS:0;jenkins-hbase20:43165] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:52:48,471 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,473 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-29 16:52:48,481 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,481 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,482 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,483 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,483 DEBUG [RS:0;jenkins-hbase20:43165] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 16:52:48,490 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,490 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,491 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,510 INFO [RS:0;jenkins-hbase20:43165] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-29 16:52:48,513 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,43165,1698598366173-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:48,537 INFO [RS:0;jenkins-hbase20:43165] regionserver.Replication(203): jenkins-hbase20.apache.org,43165,1698598366173 started 2023-10-29 16:52:48,538 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,43165,1698598366173, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:43165, sessionid=0x1017e9cf5f50001 2023-10-29 16:52:48,538 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-29 16:52:48,538 DEBUG [RS:0;jenkins-hbase20:43165] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,538 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43165,1698598366173' 2023-10-29 16:52:48,538 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:48,539 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,43165,1698598366173' 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 16:52:48,540 DEBUG [RS:0;jenkins-hbase20:43165] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 16:52:48,541 DEBUG [RS:0;jenkins-hbase20:43165] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-29 16:52:48,541 INFO [RS:0;jenkins-hbase20:43165] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-29 16:52:48,541 INFO [RS:0;jenkins-hbase20:43165] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-29 16:52:48,544 DEBUG [jenkins-hbase20:42601] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-29 16:52:48,547 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43165,1698598366173, state=OPENING 2023-10-29 16:52:48,555 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-29 16:52:48,556 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:48,556 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 16:52:48,560 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:52:48,651 INFO [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43165%2C1698598366173, suffix=, logDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173, archiveDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/oldWALs, maxLogs=32 2023-10-29 16:52:48,672 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK] 2023-10-29 16:52:48,687 INFO [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173/jenkins-hbase20.apache.org%2C43165%2C1698598366173.1698598368654 2023-10-29 16:52:48,688 DEBUG [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK]] 2023-10-29 16:52:48,746 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:48,750 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 16:52:48,754 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 16:52:48,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-29 16:52:48,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 16:52:48,771 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C43165%2C1698598366173.meta, suffix=.meta, logDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173, archiveDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/oldWALs, maxLogs=32 2023-10-29 16:52:48,789 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK] 2023-10-29 16:52:48,796 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173/jenkins-hbase20.apache.org%2C43165%2C1698598366173.meta.1698598368773.meta 2023-10-29 16:52:48,798 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38025,DS-5cd5dcf8-980f-4017-b9d9-8b6f11174904,DISK]] 2023-10-29 16:52:48,799 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:52:48,801 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-29 16:52:48,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-29 16:52:48,828 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-29 16:52:48,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-29 16:52:48,835 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:48,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-29 16:52:48,836 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-29 16:52:48,839 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 16:52:48,841 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/info 2023-10-29 16:52:48,841 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/info 2023-10-29 16:52:48,842 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 16:52:48,843 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,843 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 16:52:48,845 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/rep_barrier 2023-10-29 16:52:48,845 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/rep_barrier 2023-10-29 16:52:48,846 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 16:52:48,848 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 16:52:48,851 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/table 2023-10-29 16:52:48,851 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/table 2023-10-29 16:52:48,851 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 16:52:48,853 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:48,856 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740 2023-10-29 16:52:48,859 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740 2023-10-29 16:52:48,863 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 16:52:48,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 16:52:48,867 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63660696, jitterRate=-0.051381707191467285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 16:52:48,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 16:52:48,879 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698598368738 2023-10-29 16:52:48,896 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-29 16:52:48,897 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-29 16:52:48,897 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,43165,1698598366173, state=OPEN 2023-10-29 16:52:48,899 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-29 16:52:48,899 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 16:52:48,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-29 16:52:48,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,43165,1698598366173 in 339 msec 2023-10-29 16:52:48,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-29 16:52:48,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 529 msec 2023-10-29 16:52:48,914 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 731 msec 2023-10-29 16:52:48,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698598368914, completionTime=-1 2023-10-29 16:52:48,914 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-29 16:52:48,915 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-29 16:52:48,970 DEBUG [hconnection-0x4cf4d237-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:52:48,973 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:52:48,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-29 16:52:48,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698598428993 2023-10-29 16:52:48,993 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698598488993 2023-10-29 16:52:48,994 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 78 msec 2023-10-29 16:52:49,021 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1698598365195-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:49,021 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1698598365195-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:49,022 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1698598365195-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:49,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:42601, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:49,023 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-29 16:52:49,031 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-29 16:52:49,041 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-29 16:52:49,043 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 16:52:49,054 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-29 16:52:49,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:52:49,060 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:52:49,085 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6 empty. 2023-10-29 16:52:49,089 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-29 16:52:49,515 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-29 16:52:49,518 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e30249e1bca8e8de96f475892eacf6d6, NAME => 'hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:52:49,532 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:49,532 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e30249e1bca8e8de96f475892eacf6d6, disabling compactions & flushes 2023-10-29 16:52:49,532 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,532 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,532 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. after waiting 0 ms 2023-10-29 16:52:49,533 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,533 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,533 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e30249e1bca8e8de96f475892eacf6d6: 2023-10-29 16:52:49,538 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:52:49,557 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698598369541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598369541"}]},"ts":"1698598369541"} 2023-10-29 16:52:49,586 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:52:49,588 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:52:49,592 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598369588"}]},"ts":"1698598369588"} 2023-10-29 16:52:49,596 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-29 16:52:49,606 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e30249e1bca8e8de96f475892eacf6d6, ASSIGN}] 2023-10-29 16:52:49,609 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e30249e1bca8e8de96f475892eacf6d6, ASSIGN 2023-10-29 16:52:49,611 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e30249e1bca8e8de96f475892eacf6d6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:52:49,762 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e30249e1bca8e8de96f475892eacf6d6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:49,762 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698598369762"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598369762"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598369762"}]},"ts":"1698598369762"} 2023-10-29 16:52:49,768 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e30249e1bca8e8de96f475892eacf6d6, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:52:49,922 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:49,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e30249e1bca8e8de96f475892eacf6d6, NAME => 'hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:52:49,932 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:49,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,933 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,936 INFO [StoreOpener-e30249e1bca8e8de96f475892eacf6d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,938 DEBUG [StoreOpener-e30249e1bca8e8de96f475892eacf6d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/info 2023-10-29 16:52:49,939 DEBUG [StoreOpener-e30249e1bca8e8de96f475892eacf6d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/info 2023-10-29 16:52:49,939 INFO [StoreOpener-e30249e1bca8e8de96f475892eacf6d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e30249e1bca8e8de96f475892eacf6d6 columnFamilyName info 2023-10-29 16:52:49,940 INFO [StoreOpener-e30249e1bca8e8de96f475892eacf6d6-1] regionserver.HStore(310): Store=e30249e1bca8e8de96f475892eacf6d6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:49,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:52:49,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:52:49,956 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e30249e1bca8e8de96f475892eacf6d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62418692, jitterRate=-0.06988900899887085}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:52:49,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e30249e1bca8e8de96f475892eacf6d6: 2023-10-29 16:52:49,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6., pid=6, masterSystemTime=1698598369922 2023-10-29 16:52:49,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:52:49,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e30249e1bca8e8de96f475892eacf6d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:49,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698598369963"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598369963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598369963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598369963"}]},"ts":"1698598369963"} 2023-10-29 16:52:49,967 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase20.apache.org,43165,1698598366173, table=hbase:namespace, region=e30249e1bca8e8de96f475892eacf6d6. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-10-29 16:52:49,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-29 16:52:49,974 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e30249e1bca8e8de96f475892eacf6d6, server=jenkins-hbase20.apache.org,43165,1698598366173 in 202 msec 2023-10-29 16:52:49,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-29 16:52:49,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e30249e1bca8e8de96f475892eacf6d6, ASSIGN in 368 msec 2023-10-29 16:52:49,978 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:52:49,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598369979"}]},"ts":"1698598369979"} 2023-10-29 16:52:49,981 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-29 16:52:49,984 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:52:49,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 940 msec 2023-10-29 16:52:50,059 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-29 16:52:50,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-29 16:52:50,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:52:50,105 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-29 16:52:50,126 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 16:52:50,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-10-29 16:52:50,140 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-29 16:52:50,154 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 16:52:50,158 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-10-29 16:52:50,177 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-29 16:52:50,179 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-29 16:52:50,180 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.924sec 2023-10-29 16:52:50,183 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-29 16:52:50,184 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-29 16:52:50,184 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-29 16:52:50,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1698598365195-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-29 16:52:50,186 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42601,1698598365195-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-29 16:52:50,196 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-29 16:52:50,237 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(139): Connect 0x5785bd1d to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:50,243 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47187671, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:50,258 DEBUG [hconnection-0x60a3d3c1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:52:50,271 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:52:50,284 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:52:50,286 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(139): Connect 0x27cfb7ff to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:50,290 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ed594ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:50,291 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:52:50,315 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=213, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=256, ProcessCount=169, AvailableMemoryMB=3629 2023-10-29 16:52:50,325 DEBUG [Listener at localhost/45209] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:52:50,329 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:52:50,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:52:50,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:50,347 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:52:50,349 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:52:50,352 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-29 16:52:50,358 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,360 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 empty. 2023-10-29 16:52:50,362 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,362 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-29 16:52:50,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 16:52:50,386 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 16:52:50,389 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e50272c69b19a0b5b2b49937c687b92, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:52:50,407 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:50,408 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 5e50272c69b19a0b5b2b49937c687b92, disabling compactions & flushes 2023-10-29 16:52:50,408 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,408 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,408 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. after waiting 0 ms 2023-10-29 16:52:50,408 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,408 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,408 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:50,413 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:52:50,415 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598370414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598370414"}]},"ts":"1698598370414"} 2023-10-29 16:52:50,418 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:52:50,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:52:50,420 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598370419"}]},"ts":"1698598370419"} 2023-10-29 16:52:50,423 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-29 16:52:50,426 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, ASSIGN}] 2023-10-29 16:52:50,428 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, ASSIGN 2023-10-29 16:52:50,430 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:52:50,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 16:52:50,582 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:50,582 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598370582"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598370582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598370582"}]},"ts":"1698598370582"} 2023-10-29 16:52:50,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:52:50,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 16:52:50,743 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:50,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e50272c69b19a0b5b2b49937c687b92, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:52:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,760 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,763 DEBUG [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:50,763 DEBUG [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:50,766 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e50272c69b19a0b5b2b49937c687b92 columnFamilyName family1 2023-10-29 16:52:50,769 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] regionserver.HStore(310): Store=5e50272c69b19a0b5b2b49937c687b92/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:50,772 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:50,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:52:50,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5e50272c69b19a0b5b2b49937c687b92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73005261, jitterRate=0.08786316215991974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:52:50,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:50,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., pid=11, masterSystemTime=1698598370743 2023-10-29 16:52:50,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:50,789 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:50,789 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598370789"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598370789"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598370789"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598370789"}]},"ts":"1698598370789"} 2023-10-29 16:52:50,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-29 16:52:50,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173 in 206 msec 2023-10-29 16:52:50,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-29 16:52:50,801 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, ASSIGN in 370 msec 2023-10-29 16:52:50,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:52:50,802 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598370802"}]},"ts":"1698598370802"} 2023-10-29 16:52:50,804 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-29 16:52:50,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:52:50,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 465 msec 2023-10-29 16:52:50,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 16:52:50,975 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-29 16:52:50,995 DEBUG [hconnection-0x56c4e9b5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:52:50,998 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:52:51,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:51,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,166 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:51,166 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:51,167 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:51,167 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:51,167 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,168 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,168 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:51,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:51,170 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,171 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,173 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,173 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:51,173 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:51,174 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:51,175 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:51,175 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:51,175 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:51,175 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:51,176 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:52:51,347 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c0e0eafdf5234afdbf1a958c14744b1e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0e0eafdf5234afdbf1a958c14744b1e 2023-10-29 16:52:51,367 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/043c377f782c443da1dbf5b2c3845d53 2023-10-29 16:52:51,380 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/043c377f782c443da1dbf5b2c3845d53 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53 2023-10-29 16:52:51,392 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-29 16:52:51,396 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 219ms, sequenceid=5, compaction requested=false 2023-10-29 16:52:51,397 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:51,400 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:51,400 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:51,400 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:51,401 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:51,401 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,401 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:51,401 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:51,403 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,403 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:51,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:51,404 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,404 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:51,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:51,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:51,407 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:51,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2dc9a95a[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:51,407 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,413 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,414 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:51,414 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:51,414 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,414 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:51,414 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:51,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:51,416 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,416 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:51,416 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:51,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:51,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:51,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:51,420 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:51,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:51,420 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:51,420 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:51,420 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,420 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:51,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,431 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:51,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:51,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:51,434 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,437 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:51,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,444 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:51,445 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:51,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:51,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:51,445 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:51,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:51,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:51,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:51,447 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:51,447 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:51,547 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:51,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:51,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:51,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,569 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:51,569 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:51,570 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:51,570 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:51,571 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,571 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,572 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:51,572 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:51,572 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:51,572 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:51,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:51,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,573 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:51,573 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:51,573 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:51,574 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:51,574 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:51,574 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:51,574 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:51,574 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:51,574 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:51,574 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:52:52,008 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285f74a58c770c469999f97e73d65c4455 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285f74a58c770c469999f97e73d65c4455 2023-10-29 16:52:52,424 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/87ed6fdfb1804aa990bb3ef9a1a56c05 2023-10-29 16:52:52,439 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/87ed6fdfb1804aa990bb3ef9a1a56c05 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05 2023-10-29 16:52:52,448 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:52:52,450 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 876ms, sequenceid=9, compaction requested=false 2023-10-29 16:52:52,450 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:52,450 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:52,450 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:52,451 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:52,451 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,451 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:52,451 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:52,453 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,453 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:52,453 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,453 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:52,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:52,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:52,456 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7149fbea[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:52,456 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:52,456 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,457 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,457 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:52,457 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:52,457 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:52,457 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,457 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:52,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,460 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:52,461 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:52,461 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:52,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:52,466 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:52,466 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:52,466 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:52,466 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,466 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:52,493 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,493 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:52,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,494 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:52,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:52,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:52,495 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:52,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:52,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,499 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:52,505 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:52,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:52,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:52,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:52,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,506 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,506 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,506 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:52,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:52,506 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:52,507 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:52,607 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:52,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:52,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:52,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:52,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,624 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:52,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:52,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:52,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:52,625 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,625 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,626 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,626 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:52,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:52,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:52,627 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:52,627 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:52,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,628 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,629 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:52,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:52,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:52,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:52,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:52,630 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:52,630 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:52,630 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:52,630 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:52,630 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:53,064 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ac0ac7c89efe4fcf95ccfeb11d1e1b5a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac0ac7c89efe4fcf95ccfeb11d1e1b5a 2023-10-29 16:52:53,477 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/ad4dee284222406891a0aac9ef0e5f99 2023-10-29 16:52:53,489 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/ad4dee284222406891a0aac9ef0e5f99 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99 2023-10-29 16:52:53,497 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 16:52:53,499 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 869ms, sequenceid=13, compaction requested=true 2023-10-29 16:52:53,499 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:53,499 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:53,499 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:53,500 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:53,500 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,500 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:53,500 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:53,501 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,501 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:53,502 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,502 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:53,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:53,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:53,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cdc1507[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:53,504 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:53,504 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,505 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:53,506 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:53,506 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:53,506 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,506 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:53,507 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:53,507 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,507 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:53,507 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:53,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:53,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:53,512 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:53,512 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:53,512 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:53,512 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:53,512 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,512 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:53,514 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,514 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:53,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,514 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:53,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:53,515 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,519 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:53,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:53,530 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 16:52:53,530 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:53,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:53,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:53,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:53,531 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:53,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:53,631 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:53,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:53,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:53,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,644 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:53,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:53,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:53,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:53,645 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,645 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,646 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,646 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:53,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:53,646 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:53,646 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:53,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:53,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:53,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:53,647 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:53,647 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:53,648 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:53,648 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:53,648 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:53,648 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:53,648 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:53,648 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:54,078 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d6d2fff3bb94496f8ca83ef201961125 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6d2fff3bb94496f8ca83ef201961125 2023-10-29 16:52:54,359 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:52:54,441 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-29 16:52:54,443 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-29 16:52:54,494 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/62ca7ac3340d4f2aae9bab345c247d18 2023-10-29 16:52:54,504 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/62ca7ac3340d4f2aae9bab345c247d18 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18 2023-10-29 16:52:54,514 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 16:52:54,515 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 867ms, sequenceid=17, compaction requested=true 2023-10-29 16:52:54,515 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:54,515 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:54,515 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:54,516 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:54,516 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,516 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:54,516 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:54,517 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,517 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,518 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,518 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:54,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1483cddc[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:54,519 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:54,519 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,520 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,520 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:54,520 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:54,520 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,520 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:54,520 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:54,522 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:54,522 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,522 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:54,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,522 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:54,525 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:54,525 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:54,525 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:54,525 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:54,525 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,525 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:54,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:54,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:54,531 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:54,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,532 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,543 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,543 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:54,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:54,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:54,543 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:54,543 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:54,543 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:54,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:54,544 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:54,544 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:54,545 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:54,645 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:54,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:54,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:54,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:54,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,658 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:54,658 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:54,659 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:54,659 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:54,659 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,659 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,660 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:54,660 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:54,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:54,661 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,661 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:54,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,661 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,662 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:54,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,662 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:54,662 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:54,663 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:54,663 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:54,663 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:54,663 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:54,663 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:54,663 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:54,688 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228aba3a3e87fac4adfaccc7746b1cf0629 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228aba3a3e87fac4adfaccc7746b1cf0629 2023-10-29 16:52:54,703 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/c3c243e4ce4e46149c0306038c9223c3 2023-10-29 16:52:54,712 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/c3c243e4ce4e46149c0306038c9223c3 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3 2023-10-29 16:52:54,721 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 16:52:54,723 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 60ms, sequenceid=21, compaction requested=true 2023-10-29 16:52:54,723 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:54,723 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:54,723 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:54,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:54,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:54,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:54,728 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,729 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:54,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:54,731 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7460356f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:54,731 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:54,731 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,738 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:54,739 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,739 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:54,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:54,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:54,740 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,740 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,740 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:54,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,740 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:54,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:54,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:54,743 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:54,743 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:54,743 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:54,743 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,743 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:54,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:54,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:54,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:54,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:54,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:54,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:54,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:54,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:54,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:54,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,750 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:54,750 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:54,850 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:54,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:54,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:54,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:54,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,862 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:54,862 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:54,862 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:54,862 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:54,863 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,863 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,864 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,864 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:54,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:54,864 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:54,864 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:54,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,865 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:54,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:54,865 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:54,866 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:54,866 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:54,866 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:54,866 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:54,866 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:54,866 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:54,866 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:55,293 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318f12d05933e74b9cb59489b549990615 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318f12d05933e74b9cb59489b549990615 2023-10-29 16:52:55,320 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 16:52:55,320 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-29 16:52:55,703 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/eefb5fd680034a558fce856d872dbe47 2023-10-29 16:52:55,714 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/eefb5fd680034a558fce856d872dbe47 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47 2023-10-29 16:52:55,724 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 16:52:55,726 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 860ms, sequenceid=25, compaction requested=true 2023-10-29 16:52:55,726 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:55,726 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:55,726 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:55,727 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:55,727 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,727 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:55,727 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:55,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,728 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:55,732 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,732 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:55,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:55,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ac806a2[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:55,734 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:55,734 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,735 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:55,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:55,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:55,736 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,736 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:55,737 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:55,738 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:55,738 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:55,737 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:55,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:55,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:55,742 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:55,742 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:55,742 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:55,742 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,742 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:55,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:55,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,752 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:55,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:55,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,754 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:55,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:55,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:55,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:55,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:55,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:55,760 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:55,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:55,762 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:55,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:55,762 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:55,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:55,862 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:55,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:55,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:55,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:55,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,874 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:55,874 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:55,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:55,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:55,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:55,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:55,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:55,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,878 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:55,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,878 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,879 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:55,879 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,879 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:55,879 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:55,879 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:55,879 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:55,880 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:55,880 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:55,880 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:55,880 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:55,906 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f716079b567e43e3818c0af3cb32611a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f716079b567e43e3818c0af3cb32611a 2023-10-29 16:52:55,955 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/22f2333f41c8483baf477307a601f163 2023-10-29 16:52:55,965 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/22f2333f41c8483baf477307a601f163 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163 2023-10-29 16:52:55,976 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 16:52:55,977 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 97ms, sequenceid=29, compaction requested=true 2023-10-29 16:52:55,978 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:55,978 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:55,978 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:55,979 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:55,979 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,979 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:55,979 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:55,981 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:55,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:55,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:55,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:55,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@661056d1[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:55,983 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:55,983 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,984 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:55,984 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:55,984 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:55,984 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,984 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:55,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:55,985 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:55,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:55,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:55,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:55,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:55,990 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:55,990 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:55,990 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:55,990 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:55,990 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:56,020 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,020 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,020 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,021 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,028 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,028 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,028 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:56,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 16:52:56,028 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,028 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:56,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,028 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:56,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,029 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,129 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:56,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:56,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:56,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,142 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,142 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,142 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:56,143 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:56,143 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,143 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,144 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,144 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,144 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,144 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,145 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:56,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,145 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,146 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,147 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:56,147 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,147 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:56,147 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:56,147 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:56,147 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:56,147 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:56,147 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:56,174 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038a2dec0007b54b5284f04a7d20d33509 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601038a2dec0007b54b5284f04a7d20d33509 2023-10-29 16:52:56,586 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/fa2348e5841d49f28340f863224a2a06 2023-10-29 16:52:56,596 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/fa2348e5841d49f28340f863224a2a06 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06 2023-10-29 16:52:56,604 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 16:52:56,605 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 458ms, sequenceid=33, compaction requested=true 2023-10-29 16:52:56,606 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:56,606 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:56,606 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:56,606 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:56,606 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,606 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:56,606 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:56,608 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,608 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,608 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,608 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6cf78ae2[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:56,609 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:56,610 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,610 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,611 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:56,611 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:56,611 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,611 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:56,611 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:56,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:56,614 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:56,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:56,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:56,618 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:56,618 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:56,618 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:56,618 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,618 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:56,621 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,622 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,622 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,623 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,630 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,630 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,630 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:56,630 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,631 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:56,631 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:56,631 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,631 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,731 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:56,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:56,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:56,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:56,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,745 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:56,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:56,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,747 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:56,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:56,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,748 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,748 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:56,748 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:56,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:56,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:56,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:56,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:56,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:56,750 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:56,789 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e1c8dae88284430ab6222e2669de86d1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907e1c8dae88284430ab6222e2669de86d1 2023-10-29 16:52:56,804 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/0354661f323e454895a30a1cc17544ec 2023-10-29 16:52:56,815 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/0354661f323e454895a30a1cc17544ec as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec 2023-10-29 16:52:56,825 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 16:52:56,826 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 76ms, sequenceid=37, compaction requested=true 2023-10-29 16:52:56,827 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:56,827 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:56,827 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:56,827 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:56,827 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,827 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:56,827 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:56,829 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:56,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:56,832 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1949115e[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:56,832 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:56,832 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,833 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,833 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:56,833 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:56,834 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,834 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:56,834 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:56,835 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,835 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,835 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:56,835 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:56,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:56,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:56,837 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:56,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:56,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:56,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,838 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:56,839 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,839 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:56,839 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:56,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,839 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:56,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,841 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:56,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:56,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,844 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,844 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,844 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:56,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:56,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:56,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:56,845 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:56,845 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:56,945 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:56,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:56,955 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:52:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 16:52:56,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,958 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:56,958 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,959 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 16:52:56,959 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 16:52:56,960 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,960 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,961 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:56,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:56,961 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,962 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:56,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,962 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:52:56,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,962 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,963 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 16:52:56,963 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:56,963 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 16:52:56,963 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:52:56,964 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 16:52:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:52:56,965 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:52:56,965 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:56,965 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. started... 2023-10-29 16:52:56,965 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5e50272c69b19a0b5b2b49937c687b92 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:52:56,996 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120186f921bbdda47acb9d1af3d624b5ee8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120186f921bbdda47acb9d1af3d624b5ee8 2023-10-29 16:52:57,016 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/5f74dbdbd5f7496fa8f179eaad13a1d0 2023-10-29 16:52:57,027 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/5f74dbdbd5f7496fa8f179eaad13a1d0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0 2023-10-29 16:52:57,038 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 16:52:57,040 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5e50272c69b19a0b5b2b49937c687b92 in 75ms, sequenceid=41, compaction requested=true 2023-10-29 16:52:57,040 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:57,040 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:57,040 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:52:57,041 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:52:57,041 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,041 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 16:52:57,041 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 16:52:57,042 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,042 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:57,043 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:57,043 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:52:57,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:57,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 16:52:57,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13bee9c3[Count = 0] remaining members to acquire global barrier 2023-10-29 16:52:57,045 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 16:52:57,045 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,046 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 16:52:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 16:52:57,047 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:52:57,047 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,047 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:52:57,048 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 16:52:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:57,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:57,048 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 16:52:57,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:52:57,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 16:52:57,052 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 16:52:57,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:52:57,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:52:57,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,052 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:52:57,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:52:57,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:52:57,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:57,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:57,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:52:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:52:57,069 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:52:57,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,101 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,101 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:52:57,101 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:52:57,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:52:57,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:52:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:52:57,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 16:52:57,101 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:57,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 16:52:57,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:52:57,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:52:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:52:57,103 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 16:52:57,103 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:52:57,203 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:52:57,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:52:57,212 DEBUG [Listener at localhost/45209] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 16:52:57,217 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 16:52:57,218 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:57,236 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:52:57,236 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:52:57,238 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:52:57,238 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698598977238 2023-10-29 16:52:57,240 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:52:57,245 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 16:52:57,245 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:57,248 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x6383749b to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:57,253 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@704e4ef2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:57,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,376 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ec3ca426ea7042ff97bd8632da159838 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec3ca426ea7042ff97bd8632da159838 2023-10-29 16:52:57,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:57,401 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:52:57,403 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41280, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:52:57,421 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:52:57,423 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49316, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:52:57,480 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8e20c4dd75c45c281298a142da00316 first=Optional[r3] last=Optional[r6] 2023-10-29 16:52:57,494 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8e20c4dd75c45c281298a142da00316}] 2023-10-29 16:52:57,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8e20c4dd75c45c281298a142da00316 for inclusion in 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 16:52:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:52:57,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:57,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a8e20c4dd75c45c281298a142da00316 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__baq0r0rt2cdun1u9i3pgk7e7eurr3aoprmnrlluu6raics9v0dofj3beccc6fh1r/family1/a8e20c4dd75c45c281298a142da00316 2023-10-29 16:52:57,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__baq0r0rt2cdun1u9i3pgk7e7eurr3aoprmnrlluu6raics9v0dofj3beccc6fh1r/family1/a8e20c4dd75c45c281298a142da00316 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_ 2023-10-29 16:52:57,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__baq0r0rt2cdun1u9i3pgk7e7eurr3aoprmnrlluu6raics9v0dofj3beccc6fh1r/family1/a8e20c4dd75c45c281298a142da00316 into 5e50272c69b19a0b5b2b49937c687b92/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_ - updating store file list. 2023-10-29 16:52:57,540 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_ into 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:57,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__baq0r0rt2cdun1u9i3pgk7e7eurr3aoprmnrlluu6raics9v0dofj3beccc6fh1r/family1/a8e20c4dd75c45c281298a142da00316 into 5e50272c69b19a0b5b2b49937c687b92/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_) 2023-10-29 16:52:57,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__baq0r0rt2cdun1u9i3pgk7e7eurr3aoprmnrlluu6raics9v0dofj3beccc6fh1r/family1/a8e20c4dd75c45c281298a142da00316 2023-10-29 16:52:57,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:52:57,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:52:57,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 5e50272c69b19a0b5b2b49937c687b92/family1 is initiating minor compaction 2023-10-29 16:52:57,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2e85f749; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:52:57,555 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5e50272c69b19a0b5b2b49937c687b92/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:57,556 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp, totalSize=50.2 K 2023-10-29 16:52:57,557 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 87ed6fdfb1804aa990bb3ef9a1a56c05, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:52:57,557 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting ad4dee284222406891a0aac9ef0e5f99, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 62ca7ac3340d4f2aae9bab345c247d18, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting c3c243e4ce4e46149c0306038c9223c3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting eefb5fd680034a558fce856d872dbe47, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 22f2333f41c8483baf477307a601f163, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting fa2348e5841d49f28340f863224a2a06, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 0354661f323e454895a30a1cc17544ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:52:57,558 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5f74dbdbd5f7496fa8f179eaad13a1d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:52:57,559 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting aaf8dc95545747748f5adae29d82cd3f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:52:57,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:57,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:52:57,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228aba3a3e87fac4adfaccc7746b1cf0629 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228aba3a3e87fac4adfaccc7746b1cf0629 2023-10-29 16:52:57,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318f12d05933e74b9cb59489b549990615 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318f12d05933e74b9cb59489b549990615 2023-10-29 16:52:57,598 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f716079b567e43e3818c0af3cb32611a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101f716079b567e43e3818c0af3cb32611a 2023-10-29 16:52:57,602 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601038a2dec0007b54b5284f04a7d20d33509 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601038a2dec0007b54b5284f04a7d20d33509 2023-10-29 16:52:57,602 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-29 16:52:57,602 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:57,692 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5e50272c69b19a0b5b2b49937c687b92#family1#compaction#10 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:52:58,609 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/6ff3599df8ed4ea1b686be7168642058 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/6ff3599df8ed4ea1b686be7168642058 2023-10-29 16:52:58,609 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052be18417c7854735a2bfc409ba9f8b56 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052be18417c7854735a2bfc409ba9f8b56 2023-10-29 16:52:58,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:58,646 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5e50272c69b19a0b5b2b49937c687b92/family1 of 5e50272c69b19a0b5b2b49937c687b92 into 6ff3599df8ed4ea1b686be7168642058(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:52:58,651 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:58,653 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698598377553; duration=1sec 2023-10-29 16:52:58,654 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:52:58,681 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aaad0e932a2040539b595aa7cd2011d8 first=Optional[r00] last=Optional[r2] 2023-10-29 16:52:58,684 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aaad0e932a2040539b595aa7cd2011d8}] 2023-10-29 16:52:58,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aaad0e932a2040539b595aa7cd2011d8 for inclusion in 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:58,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 16:52:58,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:52:58,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:58,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/aaad0e932a2040539b595aa7cd2011d8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gb9udl6poob1jb2v0eei24dgf6mndjrrpntbboog63nt50r0mo4piik32sj3v7nc/family1/aaad0e932a2040539b595aa7cd2011d8 2023-10-29 16:52:58,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gb9udl6poob1jb2v0eei24dgf6mndjrrpntbboog63nt50r0mo4piik32sj3v7nc/family1/aaad0e932a2040539b595aa7cd2011d8 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_ 2023-10-29 16:52:58,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gb9udl6poob1jb2v0eei24dgf6mndjrrpntbboog63nt50r0mo4piik32sj3v7nc/family1/aaad0e932a2040539b595aa7cd2011d8 into 5e50272c69b19a0b5b2b49937c687b92/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_ - updating store file list. 2023-10-29 16:52:58,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_] to archive 2023-10-29 16:52:58,724 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:52:58,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/87ed6fdfb1804aa990bb3ef9a1a56c05 2023-10-29 16:52:58,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_ into 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:58,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gb9udl6poob1jb2v0eei24dgf6mndjrrpntbboog63nt50r0mo4piik32sj3v7nc/family1/aaad0e932a2040539b595aa7cd2011d8 into 5e50272c69b19a0b5b2b49937c687b92/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_) 2023-10-29 16:52:58,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__gb9udl6poob1jb2v0eei24dgf6mndjrrpntbboog63nt50r0mo4piik32sj3v7nc/family1/aaad0e932a2040539b595aa7cd2011d8 2023-10-29 16:52:58,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:52:58,736 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ad4dee284222406891a0aac9ef0e5f99 2023-10-29 16:52:58,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:52:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 5e50272c69b19a0b5b2b49937c687b92/family1 is initiating minor compaction (all files) 2023-10-29 16:52:58,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7e1b689c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:52:58,739 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5e50272c69b19a0b5b2b49937c687b92/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:58,740 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/6ff3599df8ed4ea1b686be7168642058, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp, totalSize=358.6 K 2023-10-29 16:52:58,742 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/62ca7ac3340d4f2aae9bab345c247d18 2023-10-29 16:52:58,742 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 043c377f782c443da1dbf5b2c3845d53, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:52:58,745 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 6ff3599df8ed4ea1b686be7168642058, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:52:58,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:58,749 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c3c243e4ce4e46149c0306038c9223c3 2023-10-29 16:52:58,747 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting ed90c7f8348b49809a16a846e8a17281_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850293 2023-10-29 16:52:58,751 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:52:58,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0e0eafdf5234afdbf1a958c14744b1e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0e0eafdf5234afdbf1a958c14744b1e 2023-10-29 16:52:58,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/eefb5fd680034a558fce856d872dbe47 2023-10-29 16:52:58,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac0ac7c89efe4fcf95ccfeb11d1e1b5a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201ac0ac7c89efe4fcf95ccfeb11d1e1b5a 2023-10-29 16:52:58,768 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6d2fff3bb94496f8ca83ef201961125 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6d2fff3bb94496f8ca83ef201961125 2023-10-29 16:52:58,768 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-29 16:52:58,768 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 16:52:58,769 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:58,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:58,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:52:58,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/22f2333f41c8483baf477307a601f163 2023-10-29 16:52:58,772 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/fa2348e5841d49f28340f863224a2a06 2023-10-29 16:52:58,774 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/0354661f323e454895a30a1cc17544ec 2023-10-29 16:52:58,779 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:52:58,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.5540 sec 2023-10-29 16:52:58,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/5f74dbdbd5f7496fa8f179eaad13a1d0 2023-10-29 16:52:58,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/aaf8dc95545747748f5adae29d82cd3f_SeqId_44_ 2023-10-29 16:52:58,861 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5e50272c69b19a0b5b2b49937c687b92#family1#compaction#11 average throughput is 2.95 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:52:59,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 16:52:59,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:59,197 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 16:52:59,199 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 16:52:59,200 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 16:52:59,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-29 16:52:59,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, REOPEN/MOVE}] 2023-10-29 16:52:59,233 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, REOPEN/MOVE 2023-10-29 16:52:59,235 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:59,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598379235"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598379235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598379235"}]},"ts":"1698598379235"} 2023-10-29 16:52:59,242 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:52:59,399 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/.tmp/family1/b8c657f69b1b4198841cbb921bb5e6b3 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/b8c657f69b1b4198841cbb921bb5e6b3 2023-10-29 16:52:59,405 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:59,408 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5e50272c69b19a0b5b2b49937c687b92, disabling compactions & flushes 2023-10-29 16:52:59,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,417 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5e50272c69b19a0b5b2b49937c687b92/family1 of 5e50272c69b19a0b5b2b49937c687b92 into b8c657f69b1b4198841cbb921bb5e6b3(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:52:59,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. after waiting 0 ms 2023-10-29 16:52:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,418 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:59,426 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698598378739; duration=0sec 2023-10-29 16:52:59,427 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:52:59,433 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/6ff3599df8ed4ea1b686be7168642058, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_] to archive 2023-10-29 16:52:59,434 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:52:59,447 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/043c377f782c443da1dbf5b2c3845d53 2023-10-29 16:52:59,454 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/6ff3599df8ed4ea1b686be7168642058 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/6ff3599df8ed4ea1b686be7168642058 2023-10-29 16:52:59,457 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/ed90c7f8348b49809a16a846e8a17281_SeqId_47_ 2023-10-29 16:52:59,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 16:52:59,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,477 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:59,477 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 5e50272c69b19a0b5b2b49937c687b92 to self. 2023-10-29 16:52:59,480 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,480 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=CLOSED 2023-10-29 16:52:59,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598379480"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598379480"}]},"ts":"1698598379480"} 2023-10-29 16:52:59,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-29 16:52:59,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173 in 242 msec 2023-10-29 16:52:59,493 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=true 2023-10-29 16:52:59,644 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:59,644 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598379644"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598379644"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598379644"}]},"ts":"1698598379644"} 2023-10-29 16:52:59,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:52:59,802 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:59,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e50272c69b19a0b5b2b49937c687b92, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:52:59,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:52:59,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,809 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,811 DEBUG [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:59,811 DEBUG [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:52:59,812 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e50272c69b19a0b5b2b49937c687b92 columnFamilyName family1 2023-10-29 16:52:59,825 DEBUG [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/b8c657f69b1b4198841cbb921bb5e6b3 2023-10-29 16:52:59,826 INFO [StoreOpener-5e50272c69b19a0b5b2b49937c687b92-1] regionserver.HStore(310): Store=5e50272c69b19a0b5b2b49937c687b92/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:52:59,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:52:59,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5e50272c69b19a0b5b2b49937c687b92; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73616903, jitterRate=0.0969773381948471}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:52:59,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:52:59,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., pid=17, masterSystemTime=1698598379801 2023-10-29 16:52:59,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=5e50272c69b19a0b5b2b49937c687b92, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:52:59,843 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698598379842"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598379842"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598379842"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598379842"}]},"ts":"1698598379842"} 2023-10-29 16:52:59,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:52:59,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-29 16:52:59,851 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 5e50272c69b19a0b5b2b49937c687b92, server=jenkins-hbase20.apache.org,43165,1698598366173 in 200 msec 2023-10-29 16:52:59,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-29 16:52:59,855 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=5e50272c69b19a0b5b2b49937c687b92, REOPEN/MOVE in 620 msec 2023-10-29 16:52:59,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-29 16:52:59,863 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 652 msec 2023-10-29 16:52:59,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 732 msec 2023-10-29 16:52:59,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-29 16:52:59,887 INFO [Listener at localhost/45209] compactions.TestMobCompactor(278): alter status finished 2023-10-29 16:52:59,888 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 16:52:59,890 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:52:59,891 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:52:59,893 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:52:59,893 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698598979893 2023-10-29 16:52:59,894 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:52:59,895 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 16:52:59,895 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:52:59,897 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x20704bb4 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:52:59,923 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@591f05e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:52:59,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:59,923 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:59,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:59,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:52:59,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:53:00,419 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a4b258cd5f974330b96c6a7cae621c4b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128a4b258cd5f974330b96c6a7cae621c4b 2023-10-29 16:53:00,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:53:00,438 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:00,440 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:00,450 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:00,452 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:00,473 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/479abdda1d7d4addb1de25c1a83c8daf first=Optional[r05] last=Optional[r8] 2023-10-29 16:53:00,474 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/479abdda1d7d4addb1de25c1a83c8daf}] 2023-10-29 16:53:00,483 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/479abdda1d7d4addb1de25c1a83c8daf for inclusion in 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:53:00,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 16:53:00,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:00,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:53:00,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/479abdda1d7d4addb1de25c1a83c8daf to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__66l73dmr06p6h0388vekskenh64a2lgjsq2ln9iir4kljgfr6u6jk7v82imdr5ij/family1/479abdda1d7d4addb1de25c1a83c8daf 2023-10-29 16:53:00,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__66l73dmr06p6h0388vekskenh64a2lgjsq2ln9iir4kljgfr6u6jk7v82imdr5ij/family1/479abdda1d7d4addb1de25c1a83c8daf as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c0cac985822e48599445d813302bdce1_SeqId_53_ 2023-10-29 16:53:00,501 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__66l73dmr06p6h0388vekskenh64a2lgjsq2ln9iir4kljgfr6u6jk7v82imdr5ij/family1/479abdda1d7d4addb1de25c1a83c8daf into 5e50272c69b19a0b5b2b49937c687b92/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c0cac985822e48599445d813302bdce1_SeqId_53_ - updating store file list. 2023-10-29 16:53:00,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c0cac985822e48599445d813302bdce1_SeqId_53_ into 5e50272c69b19a0b5b2b49937c687b92/family1 2023-10-29 16:53:00,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__66l73dmr06p6h0388vekskenh64a2lgjsq2ln9iir4kljgfr6u6jk7v82imdr5ij/family1/479abdda1d7d4addb1de25c1a83c8daf into 5e50272c69b19a0b5b2b49937c687b92/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/family1/c0cac985822e48599445d813302bdce1_SeqId_53_) 2023-10-29 16:53:00,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__66l73dmr06p6h0388vekskenh64a2lgjsq2ln9iir4kljgfr6u6jk7v82imdr5ij/family1/479abdda1d7d4addb1de25c1a83c8daf 2023-10-29 16:53:00,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:53:00,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:00,517 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120186f921bbdda47acb9d1af3d624b5ee8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120186f921bbdda47acb9d1af3d624b5ee8 2023-10-29 16:53:00,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285f74a58c770c469999f97e73d65c4455 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511285f74a58c770c469999f97e73d65c4455 2023-10-29 16:53:00,519 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-29 16:53:00,519 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 16:53:00,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:53:00,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:53:00,521 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 16:53:00,521 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 16:53:00,521 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:00,523 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:00,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 634 msec 2023-10-29 16:53:00,675 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 213) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43116 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42994 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:43165-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43038 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x6383749b-SendThread(127.0.0.1:61373) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42940 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x266d2334-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42796 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1c070f6-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43086 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43022 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x6383749b-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x6383749b sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1953535232.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x266d2334-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-676709444_17 at /127.0.0.1:43032 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42884 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1c070f6-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x20704bb4-SendThread(127.0.0.1:61373) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42860 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42828 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x266d2334-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42982 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43170 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x20704bb4-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x20704bb4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1953535232.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42916 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:43068 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=603 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=273 (was 256) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 169), AvailableMemoryMB=3613 (was 3629) 2023-10-29 16:53:00,693 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=273, ProcessCount=169, AvailableMemoryMB=3620 2023-10-29 16:53:00,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 16:53:00,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:00,703 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:00,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-29 16:53:00,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 16:53:00,714 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:00,729 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4 2023-10-29 16:53:00,738 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4 empty. 2023-10-29 16:53:00,739 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4 2023-10-29 16:53:00,740 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-29 16:53:00,775 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:00,777 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b176745e20708cde79d0b687463564c4, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:00,795 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:00,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing b176745e20708cde79d0b687463564c4, disabling compactions & flushes 2023-10-29 16:53:00,796 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:00,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:00,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. after waiting 0 ms 2023-10-29 16:53:00,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:00,796 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:00,796 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:00,800 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:00,801 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598380801"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598380801"}]},"ts":"1698598380801"} 2023-10-29 16:53:00,804 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:53:00,806 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:00,806 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598380806"}]},"ts":"1698598380806"} 2023-10-29 16:53:00,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 16:53:00,809 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 16:53:00,813 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b176745e20708cde79d0b687463564c4, ASSIGN}] 2023-10-29 16:53:00,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b176745e20708cde79d0b687463564c4, ASSIGN 2023-10-29 16:53:00,818 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b176745e20708cde79d0b687463564c4, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:00,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b176745e20708cde79d0b687463564c4, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:00,970 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598380969"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598380969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598380969"}]},"ts":"1698598380969"} 2023-10-29 16:53:00,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure b176745e20708cde79d0b687463564c4, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:01,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 16:53:01,129 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,133 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b176745e20708cde79d0b687463564c4, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,135 INFO [StoreOpener-b176745e20708cde79d0b687463564c4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,136 DEBUG [StoreOpener-b176745e20708cde79d0b687463564c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:01,137 DEBUG [StoreOpener-b176745e20708cde79d0b687463564c4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:01,137 INFO [StoreOpener-b176745e20708cde79d0b687463564c4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b176745e20708cde79d0b687463564c4 columnFamilyName family1 2023-10-29 16:53:01,139 INFO [StoreOpener-b176745e20708cde79d0b687463564c4-1] regionserver.HStore(310): Store=b176745e20708cde79d0b687463564c4/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:01,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b176745e20708cde79d0b687463564c4 2023-10-29 16:53:01,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:01,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b176745e20708cde79d0b687463564c4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73155824, jitterRate=0.09010672569274902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:01,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:01,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., pid=21, masterSystemTime=1698598381129 2023-10-29 16:53:01,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=b176745e20708cde79d0b687463564c4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,149 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598381149"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598381149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598381149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598381149"}]},"ts":"1698598381149"} 2023-10-29 16:53:01,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-29 16:53:01,154 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure b176745e20708cde79d0b687463564c4, server=jenkins-hbase20.apache.org,43165,1698598366173 in 175 msec 2023-10-29 16:53:01,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-29 16:53:01,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=b176745e20708cde79d0b687463564c4, ASSIGN in 340 msec 2023-10-29 16:53:01,156 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:01,157 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598381156"}]},"ts":"1698598381156"} 2023-10-29 16:53:01,158 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 16:53:01,161 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:01,163 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 463 msec 2023-10-29 16:53:01,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 16:53:01,311 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-29 16:53:01,361 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:01,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,367 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:01,367 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:01,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:01,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:01,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,369 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:01,369 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:01,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:01,370 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,370 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:01,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,370 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:01,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,371 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,371 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,371 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:01,371 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:01,371 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:01,372 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:01,372 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:01,372 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,372 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:01,372 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:53:01,408 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113063e4afb74792425e8589a2ecf1b35da8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113063e4afb74792425e8589a2ecf1b35da8 2023-10-29 16:53:01,414 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d3737b048f024002ba5e164fbaf71fcd 2023-10-29 16:53:01,425 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d3737b048f024002ba5e164fbaf71fcd as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd 2023-10-29 16:53:01,432 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 16:53:01,433 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 61ms, sequenceid=5, compaction requested=false 2023-10-29 16:53:01,433 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:01,434 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:01,434 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:01,435 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:01,436 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,436 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:01,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:01,438 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,438 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:01,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:01,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@777c83bb[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:01,439 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:01,439 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,440 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,440 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:01,441 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:01,441 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:01,441 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,441 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:01,442 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:01,442 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:01,442 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:01,442 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:01,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:01,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:01,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:01,447 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:01,447 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:01,447 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:01,447 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:01,447 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,447 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:01,448 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,448 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,448 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:01,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:01,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:01,449 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:01,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,451 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:01,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:01,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:01,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,460 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:01,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:01,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:01,460 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,461 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,461 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,461 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,461 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,460 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:01,461 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:01,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:01,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:01,461 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:01,462 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:01,562 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:01,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:01,571 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:01,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:01,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,576 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:01,576 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:01,577 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:01,577 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:01,578 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,578 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,579 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,579 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:01,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:01,579 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:01,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,579 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:01,580 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:01,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,581 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,581 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:01,581 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:01,581 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:01,581 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:01,582 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:01,582 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:01,582 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:01,582 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:01,582 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:01,582 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:53:02,007 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286f7ca8d045d743c3b134e1bc2ef59984 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286f7ca8d045d743c3b134e1bc2ef59984 2023-10-29 16:53:02,415 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/4b8249d51a0e4c1b99a5e563ce8138a0 2023-10-29 16:53:02,424 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/4b8249d51a0e4c1b99a5e563ce8138a0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0 2023-10-29 16:53:02,431 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:53:02,432 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 850ms, sequenceid=9, compaction requested=false 2023-10-29 16:53:02,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:02,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:02,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:02,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:02,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:02,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:02,434 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,434 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:02,434 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,434 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:02,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:02,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@278ca72c[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:02,436 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:02,436 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,437 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,437 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:02,437 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:02,437 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,437 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:02,437 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:02,438 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:02,438 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:02,439 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:02,439 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:02,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:02,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:02,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:02,442 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:02,442 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:02,442 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:02,442 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,442 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:02,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,444 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:02,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:02,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:02,445 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:02,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,447 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:02,452 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,453 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:02,453 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:02,453 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:02,453 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:02,453 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:02,453 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:02,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:02,453 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:02,454 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:02,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:02,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:02,554 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:02,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:02,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:02,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,563 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:02,563 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:02,564 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:02,564 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:02,565 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,565 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,565 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:02,565 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:02,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:02,566 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:02,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,566 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:02,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:02,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,567 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,567 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:02,567 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:02,567 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:02,567 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:02,567 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:02,568 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:02,568 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:02,568 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:02,568 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:02,568 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:02,984 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012148d2db2f254f9abdcd5435d48ea255 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012148d2db2f254f9abdcd5435d48ea255 2023-10-29 16:53:02,990 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/5c8e864e152a40c78bd6801a484a0cf7 2023-10-29 16:53:02,998 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/5c8e864e152a40c78bd6801a484a0cf7 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7 2023-10-29 16:53:03,006 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 16:53:03,007 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 439ms, sequenceid=13, compaction requested=true 2023-10-29 16:53:03,007 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:03,008 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:03,008 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:03,008 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:03,008 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,008 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:03,008 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:03,009 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:03,011 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769e9162[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:03,011 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:03,011 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,012 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,012 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:03,012 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,012 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:03,012 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:03,012 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:03,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:03,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:03,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:03,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:03,017 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:03,018 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:03,018 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:03,018 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,018 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:03,021 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,021 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,021 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:03,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:03,022 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,023 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,025 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:03,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:03,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:03,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:03,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,026 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:03,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:03,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:03,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:03,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,027 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,027 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,027 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,027 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,026 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:03,027 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:03,028 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:03,028 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:03,128 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:03,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:03,136 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:03,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:03,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,138 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:03,138 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:03,139 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:03,139 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:03,139 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,140 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,140 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:03,140 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:03,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:03,141 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,141 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:03,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,141 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,142 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:03,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,142 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:03,142 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:03,142 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:03,142 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:03,142 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:03,143 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:03,143 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:03,143 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:03,564 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052393e6eae484412a81dbf2f9cc79dfb4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052393e6eae484412a81dbf2f9cc79dfb4 2023-10-29 16:53:03,572 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/1c45d5affd514701942fcaa545052b64 2023-10-29 16:53:03,578 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/1c45d5affd514701942fcaa545052b64 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64 2023-10-29 16:53:03,584 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 16:53:03,585 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 442ms, sequenceid=17, compaction requested=true 2023-10-29 16:53:03,585 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:03,585 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:03,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:03,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:03,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:03,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:03,586 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,586 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,587 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,587 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:03,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@120a9e83[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:03,588 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:03,588 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,589 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:03,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:03,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:03,589 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,589 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:03,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:03,590 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:03,592 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:03,592 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:03,592 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:03,592 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:03,592 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,592 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:03,593 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:03,593 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,593 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:03,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:03,594 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,595 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:03,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:03,597 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:03,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:03,597 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:03,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,597 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:03,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:03,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:03,597 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,597 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,598 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,598 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:03,597 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:03,598 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:03,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:03,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:03,698 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:03,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:03,704 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:03,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:03,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,705 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:03,705 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:03,706 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:03,706 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:03,706 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,706 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:03,707 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:03,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:03,708 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:03,708 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,708 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:03,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,708 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,708 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:03,709 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:03,709 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:03,709 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:03,709 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:03,709 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:03,709 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:03,709 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:03,709 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:03,709 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:04,123 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122800163643cc644c049cb26177b36fa5b2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122800163643cc644c049cb26177b36fa5b2 2023-10-29 16:53:04,529 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d1b83249d871435f9d1c2d9b65c154d3 2023-10-29 16:53:04,537 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d1b83249d871435f9d1c2d9b65c154d3 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3 2023-10-29 16:53:04,546 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 16:53:04,548 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 839ms, sequenceid=21, compaction requested=true 2023-10-29 16:53:04,548 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:04,548 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:04,548 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:04,549 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,549 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:04,550 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,550 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:04,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:04,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:04,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@178a622[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:04,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:04,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,553 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:04,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:04,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:04,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:04,554 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:04,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:04,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:04,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:04,557 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:04,557 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:04,557 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:04,558 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:04,558 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,558 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:04,569 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,569 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,569 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:04,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:04,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:04,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:04,570 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,571 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,576 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:04,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:04,576 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:04,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:04,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:04,576 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:04,576 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,576 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:04,577 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:04,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:04,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:04,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:04,677 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:04,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:04,685 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:04,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:04,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,688 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:04,689 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:04,689 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:04,689 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:04,690 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,690 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,691 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,691 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:04,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:04,691 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:04,691 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:04,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,692 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:04,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,692 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,692 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:04,692 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:04,692 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:04,692 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:04,693 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:04,693 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:04,693 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:04,693 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:04,693 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:04,693 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:04,715 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a227e677c3404dc8b1c744c9346f862b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a227e677c3404dc8b1c744c9346f862b 2023-10-29 16:53:05,008 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:53:05,123 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/f07e310d28fd4d798dfad08d654764a0 2023-10-29 16:53:05,129 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/f07e310d28fd4d798dfad08d654764a0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0 2023-10-29 16:53:05,136 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 16:53:05,137 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 444ms, sequenceid=25, compaction requested=true 2023-10-29 16:53:05,137 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:05,137 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:05,138 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,138 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:05,139 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,139 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@430fd4e6[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:05,140 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:05,140 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,141 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,141 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:05,141 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:05,141 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,141 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:05,141 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:05,142 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:05,143 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:05,143 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:05,143 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:05,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:05,146 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:05,146 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:05,146 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:05,146 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,146 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:05,147 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,147 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:05,147 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:05,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:05,148 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,149 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:05,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:05,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:05,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:05,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:05,151 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:05,151 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,152 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:05,152 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:05,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:05,152 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,152 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:05,152 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,252 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:05,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:05,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:05,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:05,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,261 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:05,261 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:05,261 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:05,261 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:05,262 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,262 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,263 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:05,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:05,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:05,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:05,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:05,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,264 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:05,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:05,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:05,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:05,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:05,266 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:05,266 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:05,266 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:05,266 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:05,266 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:05,691 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101f84f6559c72c417591815f5bd5357bd7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f84f6559c72c417591815f5bd5357bd7 2023-10-29 16:53:06,100 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/df5afd701e024a769aaeeb54dd02a798 2023-10-29 16:53:06,114 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/df5afd701e024a769aaeeb54dd02a798 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798 2023-10-29 16:53:06,122 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 16:53:06,124 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 858ms, sequenceid=29, compaction requested=true 2023-10-29 16:53:06,124 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:06,124 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:06,124 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:06,124 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:06,124 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,124 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:06,124 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:06,126 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,126 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,127 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,127 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:06,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:06,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41985864[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:06,129 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:06,129 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,130 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,130 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:06,131 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:06,131 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:06,131 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,131 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:06,132 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,132 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:06,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,132 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:06,132 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:06,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:06,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:06,136 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:06,136 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:06,137 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:06,137 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,137 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:06,138 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,138 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,138 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:06,139 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:06,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,141 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,143 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,143 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:06,143 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,144 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:06,144 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:06,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:06,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:06,144 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:06,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:06,144 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:06,144 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:06,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:06,145 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,245 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:06,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:06,264 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:06,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:06,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,269 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:06,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:06,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:06,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:06,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,272 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,272 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:06,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:06,273 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,273 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:06,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,274 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,275 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:06,275 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,275 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:06,275 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:06,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:06,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:06,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:06,276 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:06,276 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:06,276 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:06,696 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103577a74e046f9466e8bb8556514b21c02 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103577a74e046f9466e8bb8556514b21c02 2023-10-29 16:53:06,716 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d68945ff0a77425f828e229df32be91c 2023-10-29 16:53:06,726 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/d68945ff0a77425f828e229df32be91c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c 2023-10-29 16:53:06,734 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 16:53:06,736 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 460ms, sequenceid=33, compaction requested=true 2023-10-29 16:53:06,736 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:06,736 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:06,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:06,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:06,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:06,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:06,737 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,737 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,738 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,738 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:06,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7202852[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:06,739 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:06,740 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,742 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,742 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:06,742 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:06,742 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:06,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:06,744 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:06,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:06,747 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:06,748 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:06,748 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:06,748 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,748 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:06,755 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,755 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:06,755 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:06,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:06,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,760 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:06,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:06,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,760 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:06,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,760 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:06,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,761 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:06,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:06,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:06,762 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,862 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:06,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:06,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:06,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:06,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,874 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:06,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:06,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:06,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:06,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,877 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,878 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:06,878 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:06,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:06,879 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,880 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:06,880 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,880 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,881 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:06,881 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:06,881 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:06,881 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:06,881 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:06,882 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:06,882 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:06,882 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:06,882 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:06,882 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:07,311 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d4b9c26f893e41e78dd0406e2ced2bc3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907d4b9c26f893e41e78dd0406e2ced2bc3 2023-10-29 16:53:07,720 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/b1f668d0b1784cce804434f3a22791cd 2023-10-29 16:53:07,727 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/b1f668d0b1784cce804434f3a22791cd as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd 2023-10-29 16:53:07,735 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 16:53:07,736 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 854ms, sequenceid=37, compaction requested=true 2023-10-29 16:53:07,736 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:07,736 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:07,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:07,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:07,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:07,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:07,736 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:07,847 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:07,847 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:07,847 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:07,847 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:07,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:07,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:07,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:07,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43add722[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:07,853 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:07,853 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:08,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:08,013 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:08,016 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,016 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:08,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:08,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:08,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:08,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:08,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:08,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:08,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:08,059 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:08,059 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:08,059 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:08,059 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,059 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:08,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:08,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:08,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,065 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:08,067 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,067 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:08,068 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:08,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:08,067 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,068 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,068 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,068 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:08,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:08,068 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:08,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:08,168 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:08,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:08,175 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:08,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:08,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,177 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:08,177 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:08,178 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:53:08,178 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:08,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,180 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:08,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:08,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:08,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:08,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,181 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:53:08,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,181 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:53:08,181 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:08,183 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:53:08,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:08,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:08,184 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:08,184 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. started... 2023-10-29 16:53:08,184 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b176745e20708cde79d0b687463564c4 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:08,608 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112042488ecde99f4c538c36c175c10d29d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112042488ecde99f4c538c36c175c10d29d2 2023-10-29 16:53:08,616 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/a7a25964349a4546afc43cae02ddfce9 2023-10-29 16:53:08,624 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/a7a25964349a4546afc43cae02ddfce9 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9 2023-10-29 16:53:08,636 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 16:53:08,638 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b176745e20708cde79d0b687463564c4 in 454ms, sequenceid=41, compaction requested=true 2023-10-29 16:53:08,638 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:08,638 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:53:08,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:53:08,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,639 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:08,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:08,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:08,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:08,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:08,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:08,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:53:08,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eb88355[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:08,645 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:08,645 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,655 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,655 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:08,655 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:53:08,655 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:08,655 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,655 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:08,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:53:08,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:53:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:08,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:08,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:08,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:08,673 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:53:08,673 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:08,673 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:08,673 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,673 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:08,676 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,676 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:08,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,676 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:08,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:08,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:08,676 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,680 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:08,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,688 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:08,688 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:08,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:08,688 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:08,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:53:08,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 16:53:08,690 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:08,690 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:08,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:08,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:08,791 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:08,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:08,793 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-29 16:53:08,798 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:08,799 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:08,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:08,800 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698598988800 2023-10-29 16:53:08,801 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:08,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 16:53:08,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:08,804 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x081f281e to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:08,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@298e2cce, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:08,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:09,666 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039477cba5acac47678a7bb0ce3b31f77e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601039477cba5acac47678a7bb0ce3b31f77e 2023-10-29 16:53:09,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:09,684 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:09,685 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:09,694 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:09,695 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:09,710 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6a73f02ac52c4324b21278253d22353d first=Optional[r5] last=Optional[r6] 2023-10-29 16:53:09,715 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6a73f02ac52c4324b21278253d22353d}] 2023-10-29 16:53:09,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6a73f02ac52c4324b21278253d22353d for inclusion in b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 16:53:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:09,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/6a73f02ac52c4324b21278253d22353d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__n3duq66ke7lkuigqjgp1g5kvdnqbjpnglinkkfohico6hqo5etp77akp8jodo3p/family1/6a73f02ac52c4324b21278253d22353d 2023-10-29 16:53:09,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__n3duq66ke7lkuigqjgp1g5kvdnqbjpnglinkkfohico6hqo5etp77akp8jodo3p/family1/6a73f02ac52c4324b21278253d22353d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_ 2023-10-29 16:53:09,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__n3duq66ke7lkuigqjgp1g5kvdnqbjpnglinkkfohico6hqo5etp77akp8jodo3p/family1/6a73f02ac52c4324b21278253d22353d into b176745e20708cde79d0b687463564c4/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_ - updating store file list. 2023-10-29 16:53:09,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_ into b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:09,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__n3duq66ke7lkuigqjgp1g5kvdnqbjpnglinkkfohico6hqo5etp77akp8jodo3p/family1/6a73f02ac52c4324b21278253d22353d into b176745e20708cde79d0b687463564c4/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_) 2023-10-29 16:53:09,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__n3duq66ke7lkuigqjgp1g5kvdnqbjpnglinkkfohico6hqo5etp77akp8jodo3p/family1/6a73f02ac52c4324b21278253d22353d 2023-10-29 16:53:09,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:53:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:53:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): b176745e20708cde79d0b687463564c4/family1 is initiating minor compaction 2023-10-29 16:53:09,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@476e2959; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:09,740 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b176745e20708cde79d0b687463564c4/family1 in testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:09,740 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp, totalSize=49.7 K 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 4b8249d51a0e4c1b99a5e563ce8138a0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5c8e864e152a40c78bd6801a484a0cf7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 1c45d5affd514701942fcaa545052b64, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting d1b83249d871435f9d1c2d9b65c154d3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting f07e310d28fd4d798dfad08d654764a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting df5afd701e024a769aaeeb54dd02a798, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting d68945ff0a77425f828e229df32be91c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting b1f668d0b1784cce804434f3a22791cd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting a7a25964349a4546afc43cae02ddfce9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:53:09,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting c24bb724b5894659abb6312c9f15fe5f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:53:09,743 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:09,744 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:09,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f84f6559c72c417591815f5bd5357bd7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101f84f6559c72c417591815f5bd5357bd7 2023-10-29 16:53:09,747 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103577a74e046f9466e8bb8556514b21c02 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103577a74e046f9466e8bb8556514b21c02 2023-10-29 16:53:09,747 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 16:53:09,747 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 16:53:09,748 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:09,748 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:09,799 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): b176745e20708cde79d0b687463564c4#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:10,625 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/430ae34e780e485cbab54871ff7af258 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/430ae34e780e485cbab54871ff7af258 2023-10-29 16:53:10,627 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bb8394248b474d3391e59c79c7d4149f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231bb8394248b474d3391e59c79c7d4149f 2023-10-29 16:53:10,628 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:10,631 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b176745e20708cde79d0b687463564c4/family1 of b176745e20708cde79d0b687463564c4 into 430ae34e780e485cbab54871ff7af258(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:53:10,631 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:10,632 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698598389740; duration=0sec 2023-10-29 16:53:10,632 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:10,653 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af4b7988c0c14419bcc47d73821310bd first=Optional[r1] last=Optional[r4] 2023-10-29 16:53:10,654 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af4b7988c0c14419bcc47d73821310bd}] 2023-10-29 16:53:10,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af4b7988c0c14419bcc47d73821310bd for inclusion in b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:10,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 16:53:10,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:10,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:10,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/af4b7988c0c14419bcc47d73821310bd to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jmc2ftojnv2qctunql3bdkqpc5hjrb1qcl4i8ch3mqojidqmkngqu60bdqpai7fo/family1/af4b7988c0c14419bcc47d73821310bd 2023-10-29 16:53:10,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jmc2ftojnv2qctunql3bdkqpc5hjrb1qcl4i8ch3mqojidqmkngqu60bdqpai7fo/family1/af4b7988c0c14419bcc47d73821310bd as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_ 2023-10-29 16:53:10,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jmc2ftojnv2qctunql3bdkqpc5hjrb1qcl4i8ch3mqojidqmkngqu60bdqpai7fo/family1/af4b7988c0c14419bcc47d73821310bd into b176745e20708cde79d0b687463564c4/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_ - updating store file list. 2023-10-29 16:53:10,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_ into b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:10,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jmc2ftojnv2qctunql3bdkqpc5hjrb1qcl4i8ch3mqojidqmkngqu60bdqpai7fo/family1/af4b7988c0c14419bcc47d73821310bd into b176745e20708cde79d0b687463564c4/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_) 2023-10-29 16:53:10,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__jmc2ftojnv2qctunql3bdkqpc5hjrb1qcl4i8ch3mqojidqmkngqu60bdqpai7fo/family1/af4b7988c0c14419bcc47d73821310bd 2023-10-29 16:53:10,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:53:10,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:53:10,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): b176745e20708cde79d0b687463564c4/family1 is initiating minor compaction (all files) 2023-10-29 16:53:10,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5595224a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:10,672 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b176745e20708cde79d0b687463564c4/family1 in testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:53:10,672 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/430ae34e780e485cbab54871ff7af258, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp, totalSize=178.1 K 2023-10-29 16:53:10,672 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting d3737b048f024002ba5e164fbaf71fcd, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:53:10,673 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 430ae34e780e485cbab54871ff7af258, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:53:10,674 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965250293 2023-10-29 16:53:10,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:10,674 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:10,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012148d2db2f254f9abdcd5435d48ea255 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012148d2db2f254f9abdcd5435d48ea255 2023-10-29 16:53:10,677 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052393e6eae484412a81dbf2f9cc79dfb4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512052393e6eae484412a81dbf2f9cc79dfb4 2023-10-29 16:53:10,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122800163643cc644c049cb26177b36fa5b2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122800163643cc644c049cb26177b36fa5b2 2023-10-29 16:53:10,679 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a227e677c3404dc8b1c744c9346f862b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231a227e677c3404dc8b1c744c9346f862b 2023-10-29 16:53:10,679 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 16:53:10,680 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 16:53:10,680 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:10,680 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:10,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_] to archive 2023-10-29 16:53:10,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:10,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/4b8249d51a0e4c1b99a5e563ce8138a0 2023-10-29 16:53:10,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/5c8e864e152a40c78bd6801a484a0cf7 2023-10-29 16:53:10,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/1c45d5affd514701942fcaa545052b64 2023-10-29 16:53:10,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d1b83249d871435f9d1c2d9b65c154d3 2023-10-29 16:53:10,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/f07e310d28fd4d798dfad08d654764a0 2023-10-29 16:53:10,701 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): b176745e20708cde79d0b687463564c4#family1#compaction#23 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:10,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/df5afd701e024a769aaeeb54dd02a798 2023-10-29 16:53:10,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d68945ff0a77425f828e229df32be91c 2023-10-29 16:53:10,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/b1f668d0b1784cce804434f3a22791cd 2023-10-29 16:53:10,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/a7a25964349a4546afc43cae02ddfce9 2023-10-29 16:53:10,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/c24bb724b5894659abb6312c9f15fe5f_SeqId_44_ 2023-10-29 16:53:11,564 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113097226ed1fe834f28b2cfe51fa2340c9b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113097226ed1fe834f28b2cfe51fa2340c9b 2023-10-29 16:53:11,566 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:11,596 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ed6cb83e8dc4b12905b6d669e87cd78 first=Optional[r00] last=Optional[r8] 2023-10-29 16:53:11,597 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ed6cb83e8dc4b12905b6d669e87cd78}] 2023-10-29 16:53:11,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ed6cb83e8dc4b12905b6d669e87cd78 for inclusion in b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:11,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 16:53:11,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:11,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:11,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4ed6cb83e8dc4b12905b6d669e87cd78 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__7o5f6dfm89tlpke8cl2p3l78b2sl430er3p53heqvmm4f41hrgtns7fuo5b92ivv/family1/4ed6cb83e8dc4b12905b6d669e87cd78 2023-10-29 16:53:11,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__7o5f6dfm89tlpke8cl2p3l78b2sl430er3p53heqvmm4f41hrgtns7fuo5b92ivv/family1/4ed6cb83e8dc4b12905b6d669e87cd78 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/53929cb9a88944deb6ba064b60a4827f_SeqId_49_ 2023-10-29 16:53:11,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__7o5f6dfm89tlpke8cl2p3l78b2sl430er3p53heqvmm4f41hrgtns7fuo5b92ivv/family1/4ed6cb83e8dc4b12905b6d669e87cd78 into b176745e20708cde79d0b687463564c4/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/53929cb9a88944deb6ba064b60a4827f_SeqId_49_ - updating store file list. 2023-10-29 16:53:11,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/53929cb9a88944deb6ba064b60a4827f_SeqId_49_ into b176745e20708cde79d0b687463564c4/family1 2023-10-29 16:53:11,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__7o5f6dfm89tlpke8cl2p3l78b2sl430er3p53heqvmm4f41hrgtns7fuo5b92ivv/family1/4ed6cb83e8dc4b12905b6d669e87cd78 into b176745e20708cde79d0b687463564c4/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/53929cb9a88944deb6ba064b60a4827f_SeqId_49_) 2023-10-29 16:53:11,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithMonthlyPolicy__7o5f6dfm89tlpke8cl2p3l78b2sl430er3p53heqvmm4f41hrgtns7fuo5b92ivv/family1/4ed6cb83e8dc4b12905b6d669e87cd78 2023-10-29 16:53:11,616 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:11,617 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:11,619 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112042488ecde99f4c538c36c175c10d29d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112042488ecde99f4c538c36c175c10d29d2 2023-10-29 16:53:11,621 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286f7ca8d045d743c3b134e1bc2ef59984 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286f7ca8d045d743c3b134e1bc2ef59984 2023-10-29 16:53:11,622 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113063e4afb74792425e8589a2ecf1b35da8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113063e4afb74792425e8589a2ecf1b35da8 2023-10-29 16:53:11,622 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 16:53:11,622 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 16:53:11,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:11,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:11,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:53:11,623 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:53:11,624 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:11,625 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:11,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8310 sec 2023-10-29 16:53:11,742 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=259 (was 250) Potentially hanging thread: hconnection-0x66b5ce48-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46672 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46648 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46534 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46586 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46514 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/325da81120dd4eefb10a26cd3b8e6b09 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:42940 [Waiting for operation #34] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46632 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46482 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-676709444_17 at /127.0.0.1:46596 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46540 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46602 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x081f281e-SendThread(127.0.0.1:61373) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-676709444_17 at /127.0.0.1:46752 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x081f281e sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1953535232.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46746 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46606 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46674 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46616 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:61373@0x081f281e-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x66b5ce48-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-690883350_17 at /127.0.0.1:46546 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=613 (was 605) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=300 (was 273) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 169) - ProcessCount LEAK? -, AvailableMemoryMB=3309 (was 3620) 2023-10-29 16:53:11,752 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=613, MaxFileDescriptor=60000, SystemLoadAverage=300, ProcessCount=177, AvailableMemoryMB=3309 2023-10-29 16:53:11,755 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:53:11,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:11,757 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:11,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-29 16:53:11,758 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:11,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 16:53:11,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:11,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39 empty. 2023-10-29 16:53:11,760 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:11,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-29 16:53:11,769 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:11,775 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b5b7cdd77390009e7ea5fe5db6760a39, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:11,785 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:11,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing b5b7cdd77390009e7ea5fe5db6760a39, disabling compactions & flushes 2023-10-29 16:53:11,786 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:11,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:11,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. after waiting 0 ms 2023-10-29 16:53:11,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:11,786 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:11,786 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:11,789 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:11,790 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598391790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598391790"}]},"ts":"1698598391790"} 2023-10-29 16:53:11,792 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:53:11,793 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:11,793 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598391793"}]},"ts":"1698598391793"} 2023-10-29 16:53:11,795 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 16:53:11,798 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b5b7cdd77390009e7ea5fe5db6760a39, ASSIGN}] 2023-10-29 16:53:11,800 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b5b7cdd77390009e7ea5fe5db6760a39, ASSIGN 2023-10-29 16:53:11,801 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b5b7cdd77390009e7ea5fe5db6760a39, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:11,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 16:53:11,936 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/.tmp/family1/325da81120dd4eefb10a26cd3b8e6b09 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/325da81120dd4eefb10a26cd3b8e6b09 2023-10-29 16:53:11,943 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b176745e20708cde79d0b687463564c4/family1 of b176745e20708cde79d0b687463564c4 into 325da81120dd4eefb10a26cd3b8e6b09(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:53:11,943 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:53:11,943 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698598390671; duration=1sec 2023-10-29 16:53:11,943 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:11,952 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b5b7cdd77390009e7ea5fe5db6760a39, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:11,953 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598391952"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598391952"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598391952"}]},"ts":"1698598391952"} 2023-10-29 16:53:11,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure b5b7cdd77390009e7ea5fe5db6760a39, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:11,988 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/430ae34e780e485cbab54871ff7af258, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_] to archive 2023-10-29 16:53:11,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:11,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/d3737b048f024002ba5e164fbaf71fcd 2023-10-29 16:53:11,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/430ae34e780e485cbab54871ff7af258 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/430ae34e780e485cbab54871ff7af258 2023-10-29 16:53:11,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/family1/342dc918bb7c48f48ef9eebc974b07ce_SeqId_47_ 2023-10-29 16:53:12,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 16:53:12,107 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5b7cdd77390009e7ea5fe5db6760a39, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:12,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:12,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,111 INFO [StoreOpener-b5b7cdd77390009e7ea5fe5db6760a39-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,113 DEBUG [StoreOpener-b5b7cdd77390009e7ea5fe5db6760a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:12,113 DEBUG [StoreOpener-b5b7cdd77390009e7ea5fe5db6760a39-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:12,113 INFO [StoreOpener-b5b7cdd77390009e7ea5fe5db6760a39-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5b7cdd77390009e7ea5fe5db6760a39 columnFamilyName family1 2023-10-29 16:53:12,114 INFO [StoreOpener-b5b7cdd77390009e7ea5fe5db6760a39-1] regionserver.HStore(310): Store=b5b7cdd77390009e7ea5fe5db6760a39/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:12,115 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:53:12,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:12,123 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b5b7cdd77390009e7ea5fe5db6760a39; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68721674, jitterRate=0.02403274178504944}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:12,123 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:12,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39., pid=25, masterSystemTime=1698598392107 2023-10-29 16:53:12,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,127 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b5b7cdd77390009e7ea5fe5db6760a39, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,127 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598392126"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598392126"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598392126"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598392126"}]},"ts":"1698598392126"} 2023-10-29 16:53:12,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-29 16:53:12,131 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure b5b7cdd77390009e7ea5fe5db6760a39, server=jenkins-hbase20.apache.org,43165,1698598366173 in 174 msec 2023-10-29 16:53:12,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-29 16:53:12,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=b5b7cdd77390009e7ea5fe5db6760a39, ASSIGN in 333 msec 2023-10-29 16:53:12,134 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:12,134 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598392134"}]},"ts":"1698598392134"} 2023-10-29 16:53:12,135 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 16:53:12,137 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:12,139 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 383 msec 2023-10-29 16:53:12,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 16:53:12,363 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-29 16:53:12,391 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:12,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,393 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:12,393 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:12,393 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:12,393 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:12,394 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,394 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,394 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:12,394 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:12,395 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,395 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:12,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:12,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:12,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:12,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:12,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:12,396 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,396 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:12,397 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:53:12,417 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f593478ab0be4d16a2bd4ae3a75e1df3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130f593478ab0be4d16a2bd4ae3a75e1df3 2023-10-29 16:53:12,445 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:12,822 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/cb4db1d7ddc548a8b30cf1912e2ab861 2023-10-29 16:53:12,835 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/cb4db1d7ddc548a8b30cf1912e2ab861 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/cb4db1d7ddc548a8b30cf1912e2ab861 2023-10-29 16:53:12,843 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/cb4db1d7ddc548a8b30cf1912e2ab861, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 16:53:12,845 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 448ms, sequenceid=5, compaction requested=false 2023-10-29 16:53:12,845 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:12,845 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,845 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:12,846 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:12,846 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,846 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:12,846 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:12,847 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,847 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:12,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:12,848 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,848 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:12,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:12,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:12,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:12,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:12,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d60af9e[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:12,850 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:12,850 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,851 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:12,851 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:12,851 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:12,852 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,852 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:12,853 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,853 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:12,853 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:12,853 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:12,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:12,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:12,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:12,857 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:12,857 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:12,857 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:12,857 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,857 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:12,868 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,868 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:12,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:12,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,868 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:12,869 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:12,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:12,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:12,869 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:12,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,872 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:12,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:12,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:12,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,877 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:12,877 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:12,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:12,877 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:12,877 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:12,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:12,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:12,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:12,977 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:12,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:12,983 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:12,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:12,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,985 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:12,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:12,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:12,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:12,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,986 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,986 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:12,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:12,987 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:12,987 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:12,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:12,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:12,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:12,989 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:12,989 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:12,989 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:12,989 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:12,989 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:12,989 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:12,989 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:12,989 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:53:13,406 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f7c52340beb241ed91ccd4edcac9bb98 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128f7c52340beb241ed91ccd4edcac9bb98 2023-10-29 16:53:13,814 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/bfe5fd03d2314cb19b9e1dcb0b36d811 2023-10-29 16:53:13,821 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/bfe5fd03d2314cb19b9e1dcb0b36d811 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811 2023-10-29 16:53:13,828 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:53:13,829 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 840ms, sequenceid=9, compaction requested=false 2023-10-29 16:53:13,829 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:13,829 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:13,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:13,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:13,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:13,829 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:13,831 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,831 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:13,831 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,831 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:13,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:13,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:13,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:13,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:13,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b046ad8[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:13,833 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:13,833 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,834 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,834 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,834 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:13,834 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:13,834 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:13,834 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:13,835 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,836 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:13,836 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:13,836 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:13,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:13,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:13,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:13,839 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:13,839 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:13,839 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:13,840 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,840 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:13,842 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,842 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:13,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,843 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:13,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:13,843 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,845 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:13,851 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:13,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:13,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:13,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:13,851 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:13,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:13,852 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:13,851 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,952 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:13,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:13,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:13,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:13,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,963 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:13,963 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:13,963 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:13,963 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:13,964 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,964 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,966 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,966 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:13,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:13,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:13,966 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:13,966 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:13,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:13,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,968 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,968 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:13,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:13,969 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:13,969 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:13,969 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:13,969 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:13,990 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016f07e088ccd6496f909d925a900fc31c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016f07e088ccd6496f909d925a900fc31c 2023-10-29 16:53:14,398 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/807831c6d7614b4ea6809cace904e4ac 2023-10-29 16:53:14,412 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/807831c6d7614b4ea6809cace904e4ac as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac 2023-10-29 16:53:14,419 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 16:53:14,420 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 451ms, sequenceid=13, compaction requested=true 2023-10-29 16:53:14,420 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:14,420 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:14,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:14,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:14,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:14,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:14,422 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,422 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:14,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:14,423 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,423 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:14,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:14,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:14,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56bda65d[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:14,425 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:14,425 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,425 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,426 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:14,426 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:14,426 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:14,426 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,426 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:14,427 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:14,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:14,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:14,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:14,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:14,430 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:14,430 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:14,430 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:14,430 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,430 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:14,432 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,432 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,432 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:14,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:14,432 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:14,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:14,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,434 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:14,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,437 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,437 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,438 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:14,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:14,438 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:14,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:14,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:14,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:14,438 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:14,538 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:14,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:14,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:14,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:14,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,552 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:14,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:14,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:14,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:14,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,554 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,554 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:14,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:14,555 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:14,555 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,556 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,557 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,557 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:14,557 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:14,557 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:14,557 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:14,557 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:14,557 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:14,557 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:14,558 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:14,558 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:14,558 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:14,986 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512056606e56a5c5e41c6b7ea516392b30eb2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056606e56a5c5e41c6b7ea516392b30eb2 2023-10-29 16:53:15,395 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/c68bb0a836af409994c0ea160594005c 2023-10-29 16:53:15,407 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/c68bb0a836af409994c0ea160594005c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c 2023-10-29 16:53:15,414 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 16:53:15,415 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 857ms, sequenceid=17, compaction requested=true 2023-10-29 16:53:15,415 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:15,415 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:15,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:15,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:15,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:15,415 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:15,417 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,417 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:15,417 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,417 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:15,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:15,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ca525f4[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:15,419 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:15,419 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,420 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,420 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:15,420 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:15,420 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:15,420 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,420 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:15,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:15,421 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:15,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:15,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:15,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:15,424 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:15,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:15,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:15,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,424 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:15,426 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,426 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:15,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,426 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:15,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:15,426 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:15,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,428 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:15,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,429 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:15,429 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:15,429 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:15,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:15,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:15,430 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:15,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:15,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:15,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,430 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:15,431 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:15,531 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:15,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:15,537 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:15,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:15,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,539 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:15,539 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:15,539 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:15,539 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:15,540 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,540 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,541 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:15,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:15,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:15,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:15,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:15,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,542 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,542 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:15,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:15,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:15,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:15,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:15,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:15,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:15,543 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:15,543 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:15,543 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:15,963 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c92f6ae700144362a3896326480e7131 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c92f6ae700144362a3896326480e7131 2023-10-29 16:53:16,371 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/8ebac1b88c164ff2ba42044929b0ffac 2023-10-29 16:53:16,385 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/8ebac1b88c164ff2ba42044929b0ffac as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac 2023-10-29 16:53:16,392 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 16:53:16,394 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 851ms, sequenceid=21, compaction requested=true 2023-10-29 16:53:16,394 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:16,394 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:16,394 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:16,394 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:16,394 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,394 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:16,394 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:16,396 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:16,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:16,396 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,397 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:16,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:16,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:16,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@14417ba1[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:16,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:16,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,400 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,400 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:16,400 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:16,401 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:16,401 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,401 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:16,402 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:16,402 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,402 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:16,402 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:16,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:16,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:16,406 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:16,406 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:16,406 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:16,406 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:16,406 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,406 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:16,409 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,409 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:16,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,409 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:16,410 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:16,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:16,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,412 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:16,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:16,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:16,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:16,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:16,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,421 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,422 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:16,422 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:16,422 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:16,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:16,522 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:16,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:16,534 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:16,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:16,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,538 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:16,538 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:16,538 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:16,538 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:16,539 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,539 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,541 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:16,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:16,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:16,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:16,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,544 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:16,544 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:16,544 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:16,545 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:16,545 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:16,545 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:16,545 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:16,545 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:16,564 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123193d2d09911af415cba5bf6ca8ad39c47 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123193d2d09911af415cba5bf6ca8ad39c47 2023-10-29 16:53:16,971 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/7559a172e82642ab8f915b0f6a91745e 2023-10-29 16:53:16,985 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/7559a172e82642ab8f915b0f6a91745e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e 2023-10-29 16:53:16,992 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 16:53:16,993 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 448ms, sequenceid=25, compaction requested=true 2023-10-29 16:53:16,993 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:16,993 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:16,993 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:16,993 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:16,993 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,993 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:16,994 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:16,995 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,995 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:16,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:16,995 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,995 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:16,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:16,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:16,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ccb815b[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:16,997 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:16,997 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,998 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:16,999 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:16,999 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:16,999 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:16,999 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:16,999 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:17,001 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:17,001 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:17,001 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,001 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:17,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:17,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:17,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:17,005 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:17,005 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:17,005 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:17,005 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:17,005 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,005 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:17,009 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,009 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,009 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:17,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:17,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,010 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,011 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,012 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:17,013 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:17,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:17,013 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:17,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:17,013 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:17,113 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:17,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:17,120 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,122 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:17,122 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:17,122 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:17,122 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:17,123 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,123 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,124 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:17,124 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:17,124 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,124 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:17,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:17,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,125 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,125 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:17,125 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,125 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:17,125 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:17,125 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:17,125 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:17,125 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:17,125 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:17,125 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:17,125 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:17,553 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ed678302159743539c5d636e87a1b029 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed678302159743539c5d636e87a1b029 2023-10-29 16:53:17,640 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:53:17,962 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/849ba5c518674e0286bdbde8eea7e211 2023-10-29 16:53:17,973 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/849ba5c518674e0286bdbde8eea7e211 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211 2023-10-29 16:53:17,979 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 16:53:17,980 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 855ms, sequenceid=29, compaction requested=true 2023-10-29 16:53:17,980 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:17,980 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:17,980 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:17,980 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:17,980 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,980 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:17,980 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:17,982 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:17,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:17,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:17,984 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:17,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77ff59d1[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:17,984 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,985 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:17,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:17,985 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:17,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:17,986 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,986 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:17,986 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:17,986 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:17,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:17,988 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:17,989 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:17,989 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:17,989 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,989 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:17,990 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:17,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:17,990 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,991 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:17,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,992 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,992 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,992 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:17,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:17,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:17,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:17,993 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:17,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:17,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:18,093 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:18,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:18,098 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:18,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:18,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,101 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:18,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:18,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:18,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:18,102 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,102 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,103 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,103 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:18,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:18,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:18,103 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,103 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,105 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,105 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:18,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:18,105 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:18,106 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:18,106 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:18,524 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103810b09f929684839a9e56caf20383f02 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103810b09f929684839a9e56caf20383f02 2023-10-29 16:53:18,935 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/4c7c2c79814c4a26a7672ebe1b65a0bc 2023-10-29 16:53:18,949 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/4c7c2c79814c4a26a7672ebe1b65a0bc as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc 2023-10-29 16:53:18,958 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 16:53:18,960 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 854ms, sequenceid=33, compaction requested=true 2023-10-29 16:53:18,960 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:18,960 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:18,960 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:18,960 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:18,960 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,960 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:18,961 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:18,962 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,962 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:18,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:18,963 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,963 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:18,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:18,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:18,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:18,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32b0585f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:18,966 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:18,966 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,967 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,967 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:18,967 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:18,967 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,967 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:18,967 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:18,968 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:18,968 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,968 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:18,968 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:18,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:18,972 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:18,972 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:18,972 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:18,972 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:18,972 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,972 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:18,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:18,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:18,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:18,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,988 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,992 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,992 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:18,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:18,993 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:18,993 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:18,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:18,993 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:18,994 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,994 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,994 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:18,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:18,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:19,094 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:19,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:19,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:19,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:19,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,109 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:19,109 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:19,109 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:19,109 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:19,110 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,110 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,112 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:19,112 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:19,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:19,112 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,113 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:19,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:19,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,114 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:19,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,114 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:19,114 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:19,114 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:19,115 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:19,115 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:19,115 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:19,115 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:19,115 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:19,540 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090759e2f66c6889432cad856287275f7011 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090759e2f66c6889432cad856287275f7011 2023-10-29 16:53:19,950 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/f3072eb1a52445b2ad2160a96117d024 2023-10-29 16:53:19,963 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/f3072eb1a52445b2ad2160a96117d024 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024 2023-10-29 16:53:19,972 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 16:53:19,973 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 858ms, sequenceid=37, compaction requested=true 2023-10-29 16:53:19,973 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:19,973 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:19,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:19,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:19,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:19,974 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:19,975 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,975 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:19,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:19,976 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,976 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:19,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:19,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:19,978 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d33a1db[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:19,978 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:19,978 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,980 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,980 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:19,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:19,981 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,981 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:19,981 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:19,982 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:19,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:19,982 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:19,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:19,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:19,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:19,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:19,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:19,986 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:19,987 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:19,987 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:19,987 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,987 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:19,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:19,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:19,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:19,990 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:19,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:19,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,992 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:19,997 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,997 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,997 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:19,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:19,997 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:19,996 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:19,996 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:19,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:19,997 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:19,997 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:19,996 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:19,997 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:19,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:19,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:20,098 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:20,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:20,111 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:20,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,114 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:20,114 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:20,114 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:20,114 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:20,114 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,114 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,115 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,115 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:20,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:20,116 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,116 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:20,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,116 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:20,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,117 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:20,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,117 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:20,117 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:20,117 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:20,117 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:20,117 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:20,117 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:20,117 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. started... 2023-10-29 16:53:20,118 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b5b7cdd77390009e7ea5fe5db6760a39 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:20,540 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a12e5399c1f149bca163ad47cb7a849b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120a12e5399c1f149bca163ad47cb7a849b 2023-10-29 16:53:20,949 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/34ca097ce757433e97899ef6987ad41f 2023-10-29 16:53:20,964 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/34ca097ce757433e97899ef6987ad41f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f 2023-10-29 16:53:20,969 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 16:53:20,970 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b5b7cdd77390009e7ea5fe5db6760a39 in 852ms, sequenceid=41, compaction requested=true 2023-10-29 16:53:20,970 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:20,971 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:20,971 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:20,971 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:20,971 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,971 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:20,971 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:20,972 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,972 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:20,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:20,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,973 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:20,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:20,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:20,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:20,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:20,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d622c7f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:20,974 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:20,974 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,975 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,975 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:20,975 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:20,975 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:20,975 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,975 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:20,976 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,976 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:20,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:20,976 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:20,976 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:20,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:20,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:20,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:20,980 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:20,980 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:20,980 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:20,980 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:20,980 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,980 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:20,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:20,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,984 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:20,985 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,986 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,988 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:20,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:20,988 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:20,988 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 16:53:20,989 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:20,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:20,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,989 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:20,989 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:20,989 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:21,089 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:21,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:21,093 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-29 16:53:21,097 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:21,098 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:21,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:21,100 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599001100 2023-10-29 16:53:21,102 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:53:21,104 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 16:53:21,104 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:21,106 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x04676596 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:21,110 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c57c188, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:21,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,554 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037f1522dac9df42cb9c6c9092c967bd14 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601037f1522dac9df42cb9c6c9092c967bd14 2023-10-29 16:53:21,555 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:21,566 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:21,567 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:21,574 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:21,576 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:21,586 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 first=Optional[r3] last=Optional[r6] 2023-10-29 16:53:21,586 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de0a52f6fc394c7c88b3dc8ad1fd7725}] 2023-10-29 16:53:21,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 for inclusion in b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 16:53:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:21,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:21,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3n50efudgo4v2rc5lqfl7jt6e7pg1oul5610krj73mjouo3mv7t30opo24u9ktqa/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 2023-10-29 16:53:21,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3n50efudgo4v2rc5lqfl7jt6e7pg1oul5610krj73mjouo3mv7t30opo24u9ktqa/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_ 2023-10-29 16:53:21,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3n50efudgo4v2rc5lqfl7jt6e7pg1oul5610krj73mjouo3mv7t30opo24u9ktqa/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 into b5b7cdd77390009e7ea5fe5db6760a39/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_ - updating store file list. 2023-10-29 16:53:21,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_ into b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:21,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3n50efudgo4v2rc5lqfl7jt6e7pg1oul5610krj73mjouo3mv7t30opo24u9ktqa/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 into b5b7cdd77390009e7ea5fe5db6760a39/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_) 2023-10-29 16:53:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__3n50efudgo4v2rc5lqfl7jt6e7pg1oul5610krj73mjouo3mv7t30opo24u9ktqa/family1/de0a52f6fc394c7c88b3dc8ad1fd7725 2023-10-29 16:53:21,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:53:21,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:53:21,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): b5b7cdd77390009e7ea5fe5db6760a39/family1 is initiating minor compaction 2023-10-29 16:53:21,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7f17c634; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:21,612 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b5b7cdd77390009e7ea5fe5db6760a39/family1 in testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:53:21,612 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp, totalSize=50.0 K 2023-10-29 16:53:21,612 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting bfe5fd03d2314cb19b9e1dcb0b36d811, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 807831c6d7614b4ea6809cace904e4ac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting c68bb0a836af409994c0ea160594005c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 8ebac1b88c164ff2ba42044929b0ffac, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 7559a172e82642ab8f915b0f6a91745e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 849ba5c518674e0286bdbde8eea7e211, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 4c7c2c79814c4a26a7672ebe1b65a0bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting f3072eb1a52445b2ad2160a96117d024, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 34ca097ce757433e97899ef6987ad41f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:53:21,613 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:53:21,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:21,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:21,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c92f6ae700144362a3896326480e7131 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228c92f6ae700144362a3896326480e7131 2023-10-29 16:53:21,618 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123193d2d09911af415cba5bf6ca8ad39c47 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015123193d2d09911af415cba5bf6ca8ad39c47 2023-10-29 16:53:21,619 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed678302159743539c5d636e87a1b029 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed678302159743539c5d636e87a1b029 2023-10-29 16:53:21,620 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103810b09f929684839a9e56caf20383f02 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103810b09f929684839a9e56caf20383f02 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 16:53:21,620 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,620 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,621 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:21,641 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): b5b7cdd77390009e7ea5fe5db6760a39#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:22,060 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ed512a3c0bce45409ae7e618dfe10a8d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ed512a3c0bce45409ae7e618dfe10a8d 2023-10-29 16:53:22,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:22,084 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1b4d06ae940e415c8daf46c2a4e1a38e first=Optional[r1] last=Optional[r2] 2023-10-29 16:53:22,085 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1b4d06ae940e415c8daf46c2a4e1a38e}] 2023-10-29 16:53:22,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1b4d06ae940e415c8daf46c2a4e1a38e for inclusion in b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:22,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 16:53:22,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:22,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:22,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1b4d06ae940e415c8daf46c2a4e1a38e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__956q5gpijbp8pu12tap2br1b4vt9sq6mgj0uspd25v48rp7unbmqbmmpt354rain/family1/1b4d06ae940e415c8daf46c2a4e1a38e 2023-10-29 16:53:22,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__956q5gpijbp8pu12tap2br1b4vt9sq6mgj0uspd25v48rp7unbmqbmmpt354rain/family1/1b4d06ae940e415c8daf46c2a4e1a38e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/858aa480ca4d4af1bb174b2dd5100c1d_SeqId_46_ 2023-10-29 16:53:22,096 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__956q5gpijbp8pu12tap2br1b4vt9sq6mgj0uspd25v48rp7unbmqbmmpt354rain/family1/1b4d06ae940e415c8daf46c2a4e1a38e into b5b7cdd77390009e7ea5fe5db6760a39/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/858aa480ca4d4af1bb174b2dd5100c1d_SeqId_46_ - updating store file list. 2023-10-29 16:53:22,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/858aa480ca4d4af1bb174b2dd5100c1d_SeqId_46_ into b5b7cdd77390009e7ea5fe5db6760a39/family1 2023-10-29 16:53:22,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__956q5gpijbp8pu12tap2br1b4vt9sq6mgj0uspd25v48rp7unbmqbmmpt354rain/family1/1b4d06ae940e415c8daf46c2a4e1a38e into b5b7cdd77390009e7ea5fe5db6760a39/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/858aa480ca4d4af1bb174b2dd5100c1d_SeqId_46_) 2023-10-29 16:53:22,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithWeeklyPolicy__956q5gpijbp8pu12tap2br1b4vt9sq6mgj0uspd25v48rp7unbmqbmmpt354rain/family1/1b4d06ae940e415c8daf46c2a4e1a38e 2023-10-29 16:53:22,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:22,106 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:22,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016f07e088ccd6496f909d925a900fc31c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512016f07e088ccd6496f909d925a900fc31c 2023-10-29 16:53:22,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056606e56a5c5e41c6b7ea516392b30eb2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512056606e56a5c5e41c6b7ea516392b30eb2 2023-10-29 16:53:22,109 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-29 16:53:22,109 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 16:53:22,110 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:22,110 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:22,110 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:22,111 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:22,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0160 sec 2023-10-29 16:53:22,240 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 259), OpenFileDescriptor=626 (was 613) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 300), ProcessCount=168 (was 177), AvailableMemoryMB=3235 (was 3309) 2023-10-29 16:53:22,250 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=168, AvailableMemoryMB=3234 2023-10-29 16:53:22,253 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 16:53:22,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:22,256 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:22,256 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-29 16:53:22,257 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:22,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:22,259 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:22,260 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:22,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:22,260 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38 empty. 2023-10-29 16:53:22,260 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22 empty. 2023-10-29 16:53:22,260 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c empty. 2023-10-29 16:53:22,261 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:22,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:22,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:22,261 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-29 16:53:22,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:22,474 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/.tmp/family1/3e9a196e88c6408ca1ea3f29480fb6e4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/3e9a196e88c6408ca1ea3f29480fb6e4 2023-10-29 16:53:22,482 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b5b7cdd77390009e7ea5fe5db6760a39/family1 of b5b7cdd77390009e7ea5fe5db6760a39 into 3e9a196e88c6408ca1ea3f29480fb6e4(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:53:22,482 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:53:22,482 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698598401612; duration=0sec 2023-10-29 16:53:22,482 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:22,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_] to archive 2023-10-29 16:53:22,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:22,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/bfe5fd03d2314cb19b9e1dcb0b36d811 2023-10-29 16:53:22,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/807831c6d7614b4ea6809cace904e4ac 2023-10-29 16:53:22,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/c68bb0a836af409994c0ea160594005c 2023-10-29 16:53:22,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/8ebac1b88c164ff2ba42044929b0ffac 2023-10-29 16:53:22,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/7559a172e82642ab8f915b0f6a91745e 2023-10-29 16:53:22,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/849ba5c518674e0286bdbde8eea7e211 2023-10-29 16:53:22,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/4c7c2c79814c4a26a7672ebe1b65a0bc 2023-10-29 16:53:22,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/f3072eb1a52445b2ad2160a96117d024 2023-10-29 16:53:22,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/34ca097ce757433e97899ef6987ad41f 2023-10-29 16:53:22,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/family1/5d3aef9d9d484e93941d544e3cd14fee_SeqId_44_ 2023-10-29 16:53:22,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:22,670 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:22,671 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2909504afec6ba9e2c32f9b4bb85bf38, NAME => 'testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:22,671 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 0b6e4e263d82b5dd60d683d22ce5179c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:22,672 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => e75b9d7ba9a6a0449e6a9e5cfa114a22, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:22,687 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:22,687 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 0b6e4e263d82b5dd60d683d22ce5179c, disabling compactions & flushes 2023-10-29 16:53:22,687 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:22,687 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:22,688 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. after waiting 0 ms 2023-10-29 16:53:22,688 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:22,688 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:22,688 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:22,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:23,084 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:23,085 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 2909504afec6ba9e2c32f9b4bb85bf38, disabling compactions & flushes 2023-10-29 16:53:23,085 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,085 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,085 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. after waiting 0 ms 2023-10-29 16:53:23,085 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,085 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,085 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 2909504afec6ba9e2c32f9b4bb85bf38: 2023-10-29 16:53:23,086 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:23,086 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing e75b9d7ba9a6a0449e6a9e5cfa114a22, disabling compactions & flushes 2023-10-29 16:53:23,086 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,086 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,086 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. after waiting 0 ms 2023-10-29 16:53:23,086 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,086 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,087 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for e75b9d7ba9a6a0449e6a9e5cfa114a22: 2023-10-29 16:53:23,091 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:23,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598403093"}]},"ts":"1698598403093"} 2023-10-29 16:53:23,093 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598403093"}]},"ts":"1698598403093"} 2023-10-29 16:53:23,094 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698598403093"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598403093"}]},"ts":"1698598403093"} 2023-10-29 16:53:23,098 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 16:53:23,098 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:23,098 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598403098"}]},"ts":"1698598403098"} 2023-10-29 16:53:23,100 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-29 16:53:23,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2909504afec6ba9e2c32f9b4bb85bf38, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e75b9d7ba9a6a0449e6a9e5cfa114a22, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0b6e4e263d82b5dd60d683d22ce5179c, ASSIGN}] 2023-10-29 16:53:23,104 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0b6e4e263d82b5dd60d683d22ce5179c, ASSIGN 2023-10-29 16:53:23,104 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e75b9d7ba9a6a0449e6a9e5cfa114a22, ASSIGN 2023-10-29 16:53:23,104 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2909504afec6ba9e2c32f9b4bb85bf38, ASSIGN 2023-10-29 16:53:23,105 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0b6e4e263d82b5dd60d683d22ce5179c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:23,105 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2909504afec6ba9e2c32f9b4bb85bf38, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:23,105 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e75b9d7ba9a6a0449e6a9e5cfa114a22, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:23,258 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e75b9d7ba9a6a0449e6a9e5cfa114a22, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2909504afec6ba9e2c32f9b4bb85bf38, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,258 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=0b6e4e263d82b5dd60d683d22ce5179c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,258 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698598403258"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598403258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598403258"}]},"ts":"1698598403258"} 2023-10-29 16:53:23,259 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403258"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598403258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598403258"}]},"ts":"1698598403258"} 2023-10-29 16:53:23,259 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403258"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598403258"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598403258"}]},"ts":"1698598403258"} 2023-10-29 16:53:23,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure e75b9d7ba9a6a0449e6a9e5cfa114a22, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:23,264 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 2909504afec6ba9e2c32f9b4bb85bf38, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:23,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 0b6e4e263d82b5dd60d683d22ce5179c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:23,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:23,416 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:23,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0b6e4e263d82b5dd60d683d22ce5179c, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 16:53:23,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:23,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,428 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,432 DEBUG [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1 2023-10-29 16:53:23,432 DEBUG [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1 2023-10-29 16:53:23,433 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b6e4e263d82b5dd60d683d22ce5179c columnFamilyName family1 2023-10-29 16:53:23,436 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] regionserver.HStore(310): Store=0b6e4e263d82b5dd60d683d22ce5179c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,436 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,439 DEBUG [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family2 2023-10-29 16:53:23,439 DEBUG [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family2 2023-10-29 16:53:23,440 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0b6e4e263d82b5dd60d683d22ce5179c columnFamilyName family2 2023-10-29 16:53:23,442 INFO [StoreOpener-0b6e4e263d82b5dd60d683d22ce5179c-1] regionserver.HStore(310): Store=0b6e4e263d82b5dd60d683d22ce5179c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:53:23,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:53:23,451 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:23,452 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0b6e4e263d82b5dd60d683d22ce5179c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70137259, jitterRate=0.04512660205364227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:53:23,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:23,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c., pid=33, masterSystemTime=1698598403416 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:23,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:23,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e75b9d7ba9a6a0449e6a9e5cfa114a22, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,455 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=0b6e4e263d82b5dd60d683d22ce5179c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403455"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598403455"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598403455"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598403455"}]},"ts":"1698598403455"} 2023-10-29 16:53:23,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,457 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,458 DEBUG [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/family1 2023-10-29 16:53:23,458 DEBUG [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/family1 2023-10-29 16:53:23,459 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e75b9d7ba9a6a0449e6a9e5cfa114a22 columnFamilyName family1 2023-10-29 16:53:23,460 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] regionserver.HStore(310): Store=e75b9d7ba9a6a0449e6a9e5cfa114a22/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,460 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-10-29 16:53:23,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 0b6e4e263d82b5dd60d683d22ce5179c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 192 msec 2023-10-29 16:53:23,461 DEBUG [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/family2 2023-10-29 16:53:23,462 DEBUG [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/family2 2023-10-29 16:53:23,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=0b6e4e263d82b5dd60d683d22ce5179c, ASSIGN in 358 msec 2023-10-29 16:53:23,462 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e75b9d7ba9a6a0449e6a9e5cfa114a22 columnFamilyName family2 2023-10-29 16:53:23,463 INFO [StoreOpener-e75b9d7ba9a6a0449e6a9e5cfa114a22-1] regionserver.HStore(310): Store=e75b9d7ba9a6a0449e6a9e5cfa114a22/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:53:23,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:53:23,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:23,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e75b9d7ba9a6a0449e6a9e5cfa114a22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75282015, jitterRate=0.12178944051265717}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:53:23,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e75b9d7ba9a6a0449e6a9e5cfa114a22: 2023-10-29 16:53:23,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22., pid=31, masterSystemTime=1698598403416 2023-10-29 16:53:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:23,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2909504afec6ba9e2c32f9b4bb85bf38, NAME => 'testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 16:53:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,471 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e75b9d7ba9a6a0449e6a9e5cfa114a22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,471 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698598403471"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598403471"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598403471"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598403471"}]},"ts":"1698598403471"} 2023-10-29 16:53:23,473 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42601] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase20.apache.org,43165,1698598366173, table=testScannerOnBulkLoadRefHFiles, region=e75b9d7ba9a6a0449e6a9e5cfa114a22. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-10-29 16:53:23,473 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,474 DEBUG [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/family1 2023-10-29 16:53:23,474 DEBUG [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/family1 2023-10-29 16:53:23,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-29 16:53:23,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure e75b9d7ba9a6a0449e6a9e5cfa114a22, server=jenkins-hbase20.apache.org,43165,1698598366173 in 211 msec 2023-10-29 16:53:23,475 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2909504afec6ba9e2c32f9b4bb85bf38 columnFamilyName family1 2023-10-29 16:53:23,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=e75b9d7ba9a6a0449e6a9e5cfa114a22, ASSIGN in 373 msec 2023-10-29 16:53:23,476 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] regionserver.HStore(310): Store=2909504afec6ba9e2c32f9b4bb85bf38/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,477 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,478 DEBUG [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/family2 2023-10-29 16:53:23,478 DEBUG [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/family2 2023-10-29 16:53:23,478 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2909504afec6ba9e2c32f9b4bb85bf38 columnFamilyName family2 2023-10-29 16:53:23,479 INFO [StoreOpener-2909504afec6ba9e2c32f9b4bb85bf38-1] regionserver.HStore(310): Store=2909504afec6ba9e2c32f9b4bb85bf38/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:23,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:53:23,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:53:23,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:23,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2909504afec6ba9e2c32f9b4bb85bf38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68886095, jitterRate=0.026482805609703064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:53:23,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2909504afec6ba9e2c32f9b4bb85bf38: 2023-10-29 16:53:23,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38., pid=32, masterSystemTime=1698598403416 2023-10-29 16:53:23,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:23,489 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=2909504afec6ba9e2c32f9b4bb85bf38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:23,489 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698598403488"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598403488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598403488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598403488"}]},"ts":"1698598403488"} 2023-10-29 16:53:23,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-10-29 16:53:23,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 2909504afec6ba9e2c32f9b4bb85bf38, server=jenkins-hbase20.apache.org,43165,1698598366173 in 226 msec 2023-10-29 16:53:23,494 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-10-29 16:53:23,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=2909504afec6ba9e2c32f9b4bb85bf38, ASSIGN in 390 msec 2023-10-29 16:53:23,495 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:23,496 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598403495"}]},"ts":"1698598403495"} 2023-10-29 16:53:23,497 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-29 16:53:23,499 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:23,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2470 sec 2023-10-29 16:53:24,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 16:53:24,368 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-29 16:53:24,379 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:24,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,381 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 16:53:24,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:24,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 16:53:24,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 16:53:24,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,382 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:24,382 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:24,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:24,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:24,383 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:24,383 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:24,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,383 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:24,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,384 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:24,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 16:53:24,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:24,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 16:53:24,385 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:24,385 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. started... 2023-10-29 16:53:24,385 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:53:24,385 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:24,385 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:24,386 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. started... 2023-10-29 16:53:24,386 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. started... 2023-10-29 16:53:24,386 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e75b9d7ba9a6a0449e6a9e5cfa114a22: 2023-10-29 16:53:24,387 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b6e4e263d82b5dd60d683d22ce5179c 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-29 16:53:24,386 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:24,387 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:24,386 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2909504afec6ba9e2c32f9b4bb85bf38: 2023-10-29 16:53:24,387 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:53:24,388 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:24,388 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:53:24,448 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-29 16:53:24,812 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102956f15624ec4d4880b9e6c872f493726e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102956f15624ec4d4880b9e6c872f493726e 2023-10-29 16:53:25,222 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp/family1/29b78633b8b74f93aadfcd7799f195b3 2023-10-29 16:53:25,234 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp/family1/29b78633b8b74f93aadfcd7799f195b3 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3 2023-10-29 16:53:25,243 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 16:53:25,244 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 0b6e4e263d82b5dd60d683d22ce5179c in 857ms, sequenceid=5, compaction requested=false 2023-10-29 16:53:25,245 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:25,245 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:53:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:53:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 16:53:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 16:53:25,246 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,246 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:25,246 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,247 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:25,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 16:53:25,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30decbd3[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:25,248 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 16:53:25,248 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,249 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 16:53:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 16:53:25,249 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,249 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:25,250 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 16:53:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 16:53:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:25,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 16:53:25,252 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 16:53:25,253 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:25,253 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:25,253 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,253 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:25,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:25,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:25,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:25,255 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,256 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:25,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:25,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:25,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-29 16:53:25,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 16:53:25,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:25,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,260 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:25,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:25,260 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,260 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:25,260 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,260 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:25,360 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:25,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:25,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:25,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:25,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,373 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 16:53:25,373 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:25,373 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 16:53:25,373 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 16:53:25,373 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,373 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:25,374 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:25,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:25,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:25,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:25,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:25,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,376 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-29 16:53:25,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 16:53:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:25,376 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. started... 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. started... 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 2909504afec6ba9e2c32f9b4bb85bf38: 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for e75b9d7ba9a6a0449e6a9e5cfa114a22: 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:53:25,377 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:53:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:53:25,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:25,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. started... 2023-10-29 16:53:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:53:25,378 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0b6e4e263d82b5dd60d683d22ce5179c 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-29 16:53:25,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:53:25,799 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029db8ce42d90274089a922d6c10123ea46 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029db8ce42d90274089a922d6c10123ea46 2023-10-29 16:53:26,208 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd 2023-10-29 16:53:26,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd 2023-10-29 16:53:26,226 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd, entries=2, sequenceid=9, filesize=5.0 K 2023-10-29 16:53:26,227 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 0b6e4e263d82b5dd60d683d22ce5179c in 849ms, sequenceid=9, compaction requested=false 2023-10-29 16:53:26,227 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:26,227 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:26,227 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:53:26,227 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:53:26,227 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,228 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 16:53:26,228 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 16:53:26,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:26,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:26,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 16:53:26,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9c0f37[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:26,230 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 16:53:26,231 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,231 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,231 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 16:53:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 16:53:26,232 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,232 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 16:53:26,232 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,232 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:26,233 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:26,235 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 16:53:26,235 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 16:53:26,235 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:26,235 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:26,235 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,235 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:26,236 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,236 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:26,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,236 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:26,237 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:26,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,238 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:26,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:26,239 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:26,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:26,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 16:53:26,240 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:26,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:26,240 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:26,240 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,340 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:26,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:26,354 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-29 16:53:26,356 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 16:53:26,356 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 16:53:26,357 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599006357 2023-10-29 16:53:26,357 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:26,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:26,358 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-29 16:53:26,359 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 16:53:26,360 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x11b81098 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:26,365 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7301d8a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:26,365 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 16:53:27,207 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310299f82e7ee90e241679df26b4424db8b67 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202310299f82e7ee90e241679df26b4424db8b67 2023-10-29 16:53:27,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 16:53:27,224 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:27,225 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:27,233 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:27,235 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:27,246 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/c3ae5418a1404fadb76a44e8b03250ed first=Optional[k0] last=Optional[k1] 2023-10-29 16:53:27,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/c3ae5418a1404fadb76a44e8b03250ed}] 2023-10-29 16:53:27,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/c3ae5418a1404fadb76a44e8b03250ed for inclusion in 0b6e4e263d82b5dd60d683d22ce5179c/family1 2023-10-29 16:53:27,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-29 16:53:27,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 16:53:27,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:27,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/c3ae5418a1404fadb76a44e8b03250ed to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testScannerOnBulkLoadRefHFiles__q8ud3ijh421c2d7kl7npn7igdl4a16bj8u5q43cao75q6kket1vgnh42nh8c52hh/family1/c3ae5418a1404fadb76a44e8b03250ed 2023-10-29 16:53:27,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testScannerOnBulkLoadRefHFiles__q8ud3ijh421c2d7kl7npn7igdl4a16bj8u5q43cao75q6kket1vgnh42nh8c52hh/family1/c3ae5418a1404fadb76a44e8b03250ed as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_ 2023-10-29 16:53:27,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testScannerOnBulkLoadRefHFiles__q8ud3ijh421c2d7kl7npn7igdl4a16bj8u5q43cao75q6kket1vgnh42nh8c52hh/family1/c3ae5418a1404fadb76a44e8b03250ed into 0b6e4e263d82b5dd60d683d22ce5179c/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_ - updating store file list. 2023-10-29 16:53:27,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_ into 0b6e4e263d82b5dd60d683d22ce5179c/family1 2023-10-29 16:53:27,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testScannerOnBulkLoadRefHFiles__q8ud3ijh421c2d7kl7npn7igdl4a16bj8u5q43cao75q6kket1vgnh42nh8c52hh/family1/c3ae5418a1404fadb76a44e8b03250ed into 0b6e4e263d82b5dd60d683d22ce5179c/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_) 2023-10-29 16:53:27,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testScannerOnBulkLoadRefHFiles__q8ud3ijh421c2d7kl7npn7igdl4a16bj8u5q43cao75q6kket1vgnh42nh8c52hh/family1/c3ae5418a1404fadb76a44e8b03250ed 2023-10-29 16:53:27,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:53:27,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:53:27,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 0b6e4e263d82b5dd60d683d22ce5179c/family1 is initiating minor compaction (all files) 2023-10-29 16:53:27,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@284820a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:27,277 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0b6e4e263d82b5dd60d683d22ce5179c/family1 in testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:53:27,277 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp, totalSize=15.1 K 2023-10-29 16:53:27,278 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 29b78633b8b74f93aadfcd7799f195b3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598404368 2023-10-29 16:53:27,279 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 7c6f48a4e57f4d5b9b63dcb61e5120fd, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598404368 2023-10-29 16:53:27,280 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting f0c91c3783be4df5986d08a93ab549ed_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598404368 2023-10-29 16:53:27,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 16:53:27,281 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:27,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102956f15624ec4d4880b9e6c872f493726e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023102956f15624ec4d4880b9e6c872f493726e 2023-10-29 16:53:27,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029db8ce42d90274089a922d6c10123ea46 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029db8ce42d90274089a922d6c10123ea46 2023-10-29 16:53:27,286 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-29 16:53:27,286 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 16:53:27,286 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 16:53:27,287 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 16:53:27,287 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:27,288 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 16:53:27,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 933 msec 2023-10-29 16:53:27,295 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0b6e4e263d82b5dd60d683d22ce5179c#family1#compaction#37 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:27,333 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=620 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 254), ProcessCount=168 (was 168), AvailableMemoryMB=3194 (was 3234) 2023-10-29 16:53:27,347 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=168, AvailableMemoryMB=3193 2023-10-29 16:53:27,350 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:53:27,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:27,353 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:27,353 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-29 16:53:27,354 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:27,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:27,355 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:27,356 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100 empty. 2023-10-29 16:53:27,357 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:27,357 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-29 16:53:27,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:27,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:27,706 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:53:27,706 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6383749b to 127.0.0.1:61373 2023-10-29 16:53:27,706 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:53:27,710 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:53:27,710 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b81098 to 127.0.0.1:61373 2023-10-29 16:53:27,710 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:53:27,717 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:53:27,717 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20704bb4 to 127.0.0.1:61373 2023-10-29 16:53:27,717 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:53:27,717 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:53:27,717 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x081f281e to 127.0.0.1:61373 2023-10-29 16:53:27,717 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:53:27,718 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:53:27,718 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04676596 to 127.0.0.1:61373 2023-10-29 16:53:27,718 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:53:27,767 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:27,770 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => fa199e7b26b842cefa4b3d2db5685100, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:27,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing fa199e7b26b842cefa4b3d2db5685100, disabling compactions & flushes 2023-10-29 16:53:28,178 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. after waiting 0 ms 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,178 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,178 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:28,181 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:28,182 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598408182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598408182"}]},"ts":"1698598408182"} 2023-10-29 16:53:28,183 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:53:28,184 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:28,184 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598408184"}]},"ts":"1698598408184"} 2023-10-29 16:53:28,185 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 16:53:28,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=fa199e7b26b842cefa4b3d2db5685100, ASSIGN}] 2023-10-29 16:53:28,189 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=fa199e7b26b842cefa4b3d2db5685100, ASSIGN 2023-10-29 16:53:28,189 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=fa199e7b26b842cefa4b3d2db5685100, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:28,341 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=fa199e7b26b842cefa4b3d2db5685100, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:28,341 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598408341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598408341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598408341"}]},"ts":"1698598408341"} 2023-10-29 16:53:28,344 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure fa199e7b26b842cefa4b3d2db5685100, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:28,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:28,498 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:28,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa199e7b26b842cefa4b3d2db5685100, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:28,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:28,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,505 INFO [StoreOpener-fa199e7b26b842cefa4b3d2db5685100-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,507 DEBUG [StoreOpener-fa199e7b26b842cefa4b3d2db5685100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:28,507 DEBUG [StoreOpener-fa199e7b26b842cefa4b3d2db5685100-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:28,508 INFO [StoreOpener-fa199e7b26b842cefa4b3d2db5685100-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa199e7b26b842cefa4b3d2db5685100 columnFamilyName family1 2023-10-29 16:53:28,510 INFO [StoreOpener-fa199e7b26b842cefa4b3d2db5685100-1] regionserver.HStore(310): Store=fa199e7b26b842cefa4b3d2db5685100/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:28,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:53:28,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:28,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fa199e7b26b842cefa4b3d2db5685100; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62507993, jitterRate=-0.06855832040309906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:28,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:28,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100., pid=37, masterSystemTime=1698598408498 2023-10-29 16:53:28,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:28,521 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=fa199e7b26b842cefa4b3d2db5685100, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:28,521 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698598408521"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598408521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598408521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598408521"}]},"ts":"1698598408521"} 2023-10-29 16:53:28,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-29 16:53:28,524 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure fa199e7b26b842cefa4b3d2db5685100, server=jenkins-hbase20.apache.org,43165,1698598366173 in 178 msec 2023-10-29 16:53:28,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-29 16:53:28,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=fa199e7b26b842cefa4b3d2db5685100, ASSIGN in 337 msec 2023-10-29 16:53:28,527 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:28,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598408527"}]},"ts":"1698598408527"} 2023-10-29 16:53:28,528 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 16:53:28,530 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:28,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1800 sec 2023-10-29 16:53:28,537 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/.tmp/family1/ab294a94fd9f4fa8948c7e01fe638727 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/ab294a94fd9f4fa8948c7e01fe638727 2023-10-29 16:53:28,542 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0b6e4e263d82b5dd60d683d22ce5179c/family1 of 0b6e4e263d82b5dd60d683d22ce5179c into ab294a94fd9f4fa8948c7e01fe638727(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:53:28,542 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:53:28,542 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698598407277; duration=1sec 2023-10-29 16:53:28,543 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:28,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_] to archive 2023-10-29 16:53:28,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:28,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/29b78633b8b74f93aadfcd7799f195b3 2023-10-29 16:53:28,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/7c6f48a4e57f4d5b9b63dcb61e5120fd 2023-10-29 16:53:28,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/family1/f0c91c3783be4df5986d08a93ab549ed_SeqId_12_ 2023-10-29 16:53:28,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:53:29,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 16:53:29,466 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-29 16:53:29,508 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:29,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,510 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:29,510 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:29,510 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:29,510 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:29,511 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,511 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,511 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:29,511 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:29,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:29,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:29,512 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:29,512 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:29,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,512 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,513 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:29,513 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:29,513 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:29,513 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:29,513 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:29,513 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:29,513 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:29,513 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:29,513 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:53:29,938 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c7d5508822f84ca2829f2f4f601e48ce to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d5508822f84ca2829f2f4f601e48ce 2023-10-29 16:53:30,343 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/36a985802eff45a893acd8bc0677bf15 2023-10-29 16:53:30,351 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/36a985802eff45a893acd8bc0677bf15 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15 2023-10-29 16:53:30,357 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 16:53:30,358 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 845ms, sequenceid=5, compaction requested=false 2023-10-29 16:53:30,358 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:30,359 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:30,359 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:30,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:30,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:30,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:30,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:30,361 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:30,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:30,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:30,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@30915b86[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:30,363 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:30,363 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,364 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,364 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:30,365 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:30,365 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,365 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:30,365 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:30,366 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,366 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:30,366 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:30,366 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:30,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:30,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:30,368 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:30,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:30,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:30,368 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,368 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:30,369 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,369 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:30,369 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:30,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:30,370 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,370 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:30,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,372 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:30,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:30,372 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:30,373 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:30,473 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:30,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:30,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:30,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:30,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,487 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:30,487 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:30,487 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:30,487 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:30,488 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,488 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,490 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:30,490 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:30,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:30,490 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:30,490 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:30,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:30,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:30,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:30,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:30,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:30,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:30,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:30,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:30,493 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:30,494 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:30,494 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:53:30,920 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128cd845aba6b304741b3cfee932923343d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128cd845aba6b304741b3cfee932923343d 2023-10-29 16:53:31,328 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/6e825cf2824d4d01ba9eb9cdc3939d76 2023-10-29 16:53:31,341 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/6e825cf2824d4d01ba9eb9cdc3939d76 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76 2023-10-29 16:53:31,348 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:53:31,349 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 855ms, sequenceid=9, compaction requested=false 2023-10-29 16:53:31,350 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:31,350 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:31,350 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:31,350 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:31,350 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,350 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:31,350 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:31,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,352 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:31,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:31,353 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,353 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:31,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:31,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:31,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:31,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:31,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbc983f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:31,355 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:31,355 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,359 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:31,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:31,359 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:31,359 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,359 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:31,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:31,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:31,361 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:31,361 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:31,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:31,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:31,366 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:31,366 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:31,366 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:31,366 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:31,366 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,366 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:31,368 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,368 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:31,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,368 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:31,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:31,369 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,371 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:31,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:31,374 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:31,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:31,374 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,375 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,375 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,374 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:31,375 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,375 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:31,375 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:31,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:31,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:31,475 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:31,488 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:31,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:31,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,490 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:31,491 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:31,491 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:31,491 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:31,491 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,491 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,492 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,492 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:31,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:31,492 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:31,492 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:31,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,493 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:31,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:31,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:31,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:31,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:31,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:31,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:31,493 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:31,494 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:31,494 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:31,494 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:31,910 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201de5438b692c44db5a31c9d6173cf7c62 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201de5438b692c44db5a31c9d6173cf7c62 2023-10-29 16:53:32,318 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/7af81d77147f4b59b75839144e84c22e 2023-10-29 16:53:32,333 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/7af81d77147f4b59b75839144e84c22e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e 2023-10-29 16:53:32,339 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 16:53:32,340 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 846ms, sequenceid=13, compaction requested=true 2023-10-29 16:53:32,340 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:32,340 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:32,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:32,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:32,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:32,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:32,342 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,342 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:32,342 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,342 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:32,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:32,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:32,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a7a5828[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:32,343 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:32,343 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,344 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,344 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:32,344 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:32,344 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,344 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:32,344 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:32,345 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,345 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:32,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:32,345 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:32,345 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:32,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:32,348 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:32,348 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:32,348 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:32,348 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,348 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:32,349 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,349 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:32,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,349 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:32,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:32,350 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:32,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,351 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,352 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:32,352 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:32,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:32,352 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:32,352 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:32,353 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:32,352 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,353 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:32,353 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,353 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,353 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,453 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:32,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:32,458 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:32,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:32,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,460 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:32,460 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:32,460 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:32,460 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:32,461 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,461 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,462 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,462 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:32,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:32,462 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:32,462 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:32,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:32,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:32,463 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:32,463 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:32,463 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:32,463 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:32,463 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:32,463 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:32,463 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:32,463 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:32,887 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b2513e72dcdf4da6ab81475e4be50777 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2513e72dcdf4da6ab81475e4be50777 2023-10-29 16:53:33,294 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/0a589b82c38b455d9d5e49df5baf79fe 2023-10-29 16:53:33,299 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/0a589b82c38b455d9d5e49df5baf79fe as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe 2023-10-29 16:53:33,304 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 16:53:33,305 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 842ms, sequenceid=17, compaction requested=true 2023-10-29 16:53:33,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:33,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:33,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:33,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,306 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:33,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:33,307 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,307 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:33,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:33,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3aff11e7[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:33,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:33,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,308 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:33,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:33,309 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,309 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:33,309 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:33,309 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,309 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:33,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:33,309 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:33,310 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:33,311 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:33,311 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:33,311 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:33,311 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:33,312 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,312 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:33,312 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,312 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,312 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:33,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:33,313 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,314 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:33,316 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:33,316 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:33,316 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:33,316 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:33,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:33,316 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:33,416 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:33,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:33,422 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:33,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:33,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,423 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:33,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:33,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:33,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:33,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,425 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,425 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:33,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:33,426 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:33,426 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,426 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,427 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:33,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:33,427 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:33,427 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:33,427 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:33,846 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228029e45eef205418996873f62ba1054c9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228029e45eef205418996873f62ba1054c9 2023-10-29 16:53:34,007 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:53:34,254 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/de090ddb5af04f5ba6069a4e5c145b6e 2023-10-29 16:53:34,266 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/de090ddb5af04f5ba6069a4e5c145b6e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e 2023-10-29 16:53:34,272 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 16:53:34,274 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 847ms, sequenceid=21, compaction requested=true 2023-10-29 16:53:34,274 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:34,274 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:34,274 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:34,274 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:34,274 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,274 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:34,274 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,276 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,276 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:34,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:34,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@882055[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:34,278 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:34,278 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,279 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:34,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:34,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:34,279 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,279 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:34,280 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,280 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:34,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:34,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:34,280 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:34,280 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:34,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:34,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:34,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:34,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:34,283 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:34,283 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:34,283 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:34,283 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:34,283 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,283 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:34,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:34,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:34,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:34,285 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:34,286 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,288 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:34,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:34,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:34,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:34,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:34,288 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:34,289 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:34,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:34,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:34,389 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:34,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:34,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:34,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:34,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,396 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:34,396 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:34,396 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:34,396 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:34,396 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,396 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,397 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:34,397 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:34,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:34,398 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:34,398 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,398 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:34,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,399 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,399 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:34,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:34,399 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:34,399 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:34,399 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:34,399 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:34,399 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:34,399 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:34,399 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:34,399 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:34,816 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d2824fa53f634ac7b92e170607e2745f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2824fa53f634ac7b92e170607e2745f 2023-10-29 16:53:35,225 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/ebde8adc54be40ce827e3a369e51a7e0 2023-10-29 16:53:35,239 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/ebde8adc54be40ce827e3a369e51a7e0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0 2023-10-29 16:53:35,248 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 16:53:35,249 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 850ms, sequenceid=25, compaction requested=true 2023-10-29 16:53:35,249 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:35,249 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:35,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:35,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:35,251 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,251 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:35,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:35,252 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,252 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:35,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:35,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:35,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@788d2d1b[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:35,255 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:35,255 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,256 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:35,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:35,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:35,256 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,256 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:35,257 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,258 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:35,258 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:35,258 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:35,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:35,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:35,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:35,263 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:35,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:35,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:35,263 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,263 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:35,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:35,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:35,272 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,274 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,283 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:35,283 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,284 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:35,284 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:35,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,284 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,284 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:35,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:35,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:35,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:35,285 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:35,285 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:35,385 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:35,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:35,394 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:35,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,397 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:35,397 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:35,397 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:35,397 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:35,398 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,398 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,399 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:35,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:35,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:35,400 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:35,400 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:35,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:35,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:35,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:35,403 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:35,403 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:35,403 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:35,404 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:35,404 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:35,404 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:35,404 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:35,404 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:35,824 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cc5aef8177204eeabc77c5416fad8f6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc5aef8177204eeabc77c5416fad8f6e 2023-10-29 16:53:36,234 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/aa462fbfa7f542a198720ecefc2508a8 2023-10-29 16:53:36,246 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/aa462fbfa7f542a198720ecefc2508a8 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8 2023-10-29 16:53:36,253 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 16:53:36,254 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 850ms, sequenceid=29, compaction requested=true 2023-10-29 16:53:36,254 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:36,254 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:36,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:36,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:36,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:36,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:36,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,256 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:36,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:36,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:36,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:36,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:36,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@703e913a[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:36,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:36,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,260 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:36,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:36,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:36,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:36,261 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:36,261 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:36,261 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:36,261 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:36,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:36,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:36,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:36,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:36,266 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:36,266 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:36,266 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:36,266 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,266 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:36,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:36,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:36,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:36,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:36,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:36,272 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:36,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,274 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:36,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:36,285 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:36,285 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:36,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:36,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:36,285 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:36,285 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:36,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:36,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:36,285 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:36,386 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:36,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:36,395 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:36,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:36,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,399 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:36,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:36,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:36,399 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:36,400 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,400 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,401 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,401 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:36,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:36,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:36,402 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:36,402 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:36,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:36,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,404 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:36,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:36,404 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:36,405 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:36,405 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:36,405 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:36,405 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:36,405 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:36,405 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:36,405 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:36,829 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601032a24bbd547b24e8bb77d26cf962bd0bc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032a24bbd547b24e8bb77d26cf962bd0bc 2023-10-29 16:53:37,238 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/efb63345ac8c4b2984281279ce54ae55 2023-10-29 16:53:37,251 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/efb63345ac8c4b2984281279ce54ae55 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55 2023-10-29 16:53:37,258 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 16:53:37,259 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 854ms, sequenceid=33, compaction requested=true 2023-10-29 16:53:37,259 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:37,260 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:37,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:37,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:37,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:37,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:37,261 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,261 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:37,262 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,262 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:37,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:37,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:37,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@320cd6f3[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:37,264 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:37,264 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,265 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:37,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:37,265 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:37,265 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,265 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:37,266 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,266 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:37,266 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:37,267 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:37,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:37,269 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:37,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:37,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:37,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,269 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:37,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:37,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:37,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:37,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,272 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:37,273 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:37,273 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:37,273 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:37,274 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,274 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,278 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:37,278 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:37,378 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:37,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:37,387 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:37,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:37,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,390 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:37,390 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:37,390 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:37,390 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:37,391 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,391 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,392 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,392 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:37,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:37,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:37,393 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:37,393 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:37,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,394 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:37,394 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:37,395 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:37,395 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:37,395 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:37,395 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:37,395 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:37,395 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:37,395 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:37,395 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:37,818 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073a48368af4b14a6595fbf7c59d52a61b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509073a48368af4b14a6595fbf7c59d52a61b 2023-10-29 16:53:38,227 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/5916bb40c42b48ccbf327a98cd4c057e 2023-10-29 16:53:38,239 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/5916bb40c42b48ccbf327a98cd4c057e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e 2023-10-29 16:53:38,247 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 16:53:38,248 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 853ms, sequenceid=37, compaction requested=true 2023-10-29 16:53:38,249 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:38,249 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:38,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:38,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:38,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:38,249 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:38,250 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,250 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:38,251 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,251 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:38,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:38,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:38,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7347c26f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:38,253 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:38,253 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,254 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:38,254 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,254 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:38,254 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:38,256 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:38,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:38,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:38,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:38,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:38,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:38,260 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:38,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:38,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:38,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,260 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:38,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:38,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:38,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,268 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:38,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:38,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,271 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:38,272 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:38,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:38,271 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:38,272 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 16:53:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:38,272 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,272 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:38,272 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:38,272 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:38,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:38,372 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:38,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:38,376 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:38,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:38,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,378 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:38,378 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:38,378 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 16:53:38,378 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 16:53:38,378 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,378 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,379 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:38,379 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:38,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:38,380 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:38,380 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:38,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:38,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,381 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,381 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 16:53:38,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:38,381 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 16:53:38,381 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:38,381 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 16:53:38,381 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:38,381 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:38,381 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:38,381 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. started... 2023-10-29 16:53:38,381 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fa199e7b26b842cefa4b3d2db5685100 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:38,801 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511204824c88e55f7415aa06093bb9ac12954 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511204824c88e55f7415aa06093bb9ac12954 2023-10-29 16:53:39,208 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/1f1f3fa2e5c44262bef65993d6635046 2023-10-29 16:53:39,215 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/1f1f3fa2e5c44262bef65993d6635046 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046 2023-10-29 16:53:39,222 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 16:53:39,223 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fa199e7b26b842cefa4b3d2db5685100 in 842ms, sequenceid=41, compaction requested=true 2023-10-29 16:53:39,224 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:39,224 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:39,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:39,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:39,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 16:53:39,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 16:53:39,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,226 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:39,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:39,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:39,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 16:53:39,228 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 16:53:39,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6233dce9[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:39,228 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 16:53:39,229 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,229 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:39,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 16:53:39,229 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:39,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,230 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 16:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:39,231 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 16:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:39,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:39,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:53:39,234 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 16:53:39,234 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:39,234 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:39,234 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,234 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:39,235 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:39,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:39,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:39,235 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,236 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:39,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:39,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:39,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:39,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:39,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 16:53:39,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:39,238 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:39,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:39,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:39,239 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:39,339 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:39,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:39,343 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-29 16:53:39,346 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:39,347 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:39,349 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:39,349 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599019349 2023-10-29 16:53:39,353 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:39,354 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 16:53:39,354 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:39,357 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x459d62e1 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:39,360 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b094b48, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:39,361 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,209 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039e6f4ca8fe4942b2a3e97b89a8a91ebc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601039e6f4ca8fe4942b2a3e97b89a8a91ebc 2023-10-29 16:53:40,211 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:40,226 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:40,227 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37592, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:40,235 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:40,236 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:40,244 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c2d2d9b577a245ab9654f65813d73a38 first=Optional[r3] last=Optional[r6] 2023-10-29 16:53:40,245 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c2d2d9b577a245ab9654f65813d73a38}] 2023-10-29 16:53:40,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c2d2d9b577a245ab9654f65813d73a38 for inclusion in fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:40,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 16:53:40,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:40,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:40,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/c2d2d9b577a245ab9654f65813d73a38 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u42lrmdhlmbplmfr6fbd9cd9omb6m6k51qst9kisqvqf8p7e2ep5t19ac5hf5v17/family1/c2d2d9b577a245ab9654f65813d73a38 2023-10-29 16:53:40,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u42lrmdhlmbplmfr6fbd9cd9omb6m6k51qst9kisqvqf8p7e2ep5t19ac5hf5v17/family1/c2d2d9b577a245ab9654f65813d73a38 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_ 2023-10-29 16:53:40,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u42lrmdhlmbplmfr6fbd9cd9omb6m6k51qst9kisqvqf8p7e2ep5t19ac5hf5v17/family1/c2d2d9b577a245ab9654f65813d73a38 into fa199e7b26b842cefa4b3d2db5685100/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_ - updating store file list. 2023-10-29 16:53:40,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_ into fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:40,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u42lrmdhlmbplmfr6fbd9cd9omb6m6k51qst9kisqvqf8p7e2ep5t19ac5hf5v17/family1/c2d2d9b577a245ab9654f65813d73a38 into fa199e7b26b842cefa4b3d2db5685100/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_) 2023-10-29 16:53:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__u42lrmdhlmbplmfr6fbd9cd9omb6m6k51qst9kisqvqf8p7e2ep5t19ac5hf5v17/family1/c2d2d9b577a245ab9654f65813d73a38 2023-10-29 16:53:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:53:40,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:53:40,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): fa199e7b26b842cefa4b3d2db5685100/family1 is initiating minor compaction 2023-10-29 16:53:40,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d27f3e9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:40,268 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fa199e7b26b842cefa4b3d2db5685100/family1 in testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:40,268 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp, totalSize=50.0 K 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 6e825cf2824d4d01ba9eb9cdc3939d76, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 7af81d77147f4b59b75839144e84c22e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 0a589b82c38b455d9d5e49df5baf79fe, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting de090ddb5af04f5ba6069a4e5c145b6e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting ebde8adc54be40ce827e3a369e51a7e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting aa462fbfa7f542a198720ecefc2508a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:53:40,268 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting efb63345ac8c4b2984281279ce54ae55, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:53:40,269 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5916bb40c42b48ccbf327a98cd4c057e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:53:40,269 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 1f1f3fa2e5c44262bef65993d6635046, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:53:40,269 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:53:40,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:40,271 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:40,273 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228029e45eef205418996873f62ba1054c9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228029e45eef205418996873f62ba1054c9 2023-10-29 16:53:40,274 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2824fa53f634ac7b92e170607e2745f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231d2824fa53f634ac7b92e170607e2745f 2023-10-29 16:53:40,276 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc5aef8177204eeabc77c5416fad8f6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101cc5aef8177204eeabc77c5416fad8f6e 2023-10-29 16:53:40,278 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032a24bbd547b24e8bb77d26cf962bd0bc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601032a24bbd547b24e8bb77d26cf962bd0bc 2023-10-29 16:53:40,278 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 16:53:40,278 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 16:53:40,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,279 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:40,321 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): fa199e7b26b842cefa4b3d2db5685100#family1#compaction#48 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:41,144 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/84a8952396474e23a191be64d561db60 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/84a8952396474e23a191be64d561db60 2023-10-29 16:53:41,151 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052b8c656e385c4721a521f425b0dc1780 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512052b8c656e385c4721a521f425b0dc1780 2023-10-29 16:53:41,152 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fa199e7b26b842cefa4b3d2db5685100/family1 of fa199e7b26b842cefa4b3d2db5685100 into 84a8952396474e23a191be64d561db60(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:53:41,152 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:41,152 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:41,153 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698598420267; duration=0sec 2023-10-29 16:53:41,153 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:41,175 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/044de69901c6445cb6f31fc2ec1f8b4d first=Optional[r00] last=Optional[r2] 2023-10-29 16:53:41,176 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/044de69901c6445cb6f31fc2ec1f8b4d}] 2023-10-29 16:53:41,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/044de69901c6445cb6f31fc2ec1f8b4d for inclusion in fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:41,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 16:53:41,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:41,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:41,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/044de69901c6445cb6f31fc2ec1f8b4d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f3mj5oqa7varpoj07n0inutr31bc64peail5oltv49qqc3d6e3u3ecbhovr1ans3/family1/044de69901c6445cb6f31fc2ec1f8b4d 2023-10-29 16:53:41,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f3mj5oqa7varpoj07n0inutr31bc64peail5oltv49qqc3d6e3u3ecbhovr1ans3/family1/044de69901c6445cb6f31fc2ec1f8b4d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_ 2023-10-29 16:53:41,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_] to archive 2023-10-29 16:53:41,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f3mj5oqa7varpoj07n0inutr31bc64peail5oltv49qqc3d6e3u3ecbhovr1ans3/family1/044de69901c6445cb6f31fc2ec1f8b4d into fa199e7b26b842cefa4b3d2db5685100/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_ - updating store file list. 2023-10-29 16:53:41,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:41,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/6e825cf2824d4d01ba9eb9cdc3939d76 2023-10-29 16:53:41,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/7af81d77147f4b59b75839144e84c22e 2023-10-29 16:53:41,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_ into fa199e7b26b842cefa4b3d2db5685100/family1 2023-10-29 16:53:41,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f3mj5oqa7varpoj07n0inutr31bc64peail5oltv49qqc3d6e3u3ecbhovr1ans3/family1/044de69901c6445cb6f31fc2ec1f8b4d into fa199e7b26b842cefa4b3d2db5685100/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_) 2023-10-29 16:53:41,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/0a589b82c38b455d9d5e49df5baf79fe 2023-10-29 16:53:41,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyPolicy__f3mj5oqa7varpoj07n0inutr31bc64peail5oltv49qqc3d6e3u3ecbhovr1ans3/family1/044de69901c6445cb6f31fc2ec1f8b4d 2023-10-29 16:53:41,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:53:41,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/de090ddb5af04f5ba6069a4e5c145b6e 2023-10-29 16:53:41,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:53:41,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): fa199e7b26b842cefa4b3d2db5685100/family1 is initiating minor compaction (all files) 2023-10-29 16:53:41,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@408c92c5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:41,199 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fa199e7b26b842cefa4b3d2db5685100/family1 in testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:53:41,199 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/84a8952396474e23a191be64d561db60, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp, totalSize=337.0 K 2023-10-29 16:53:41,199 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 36a985802eff45a893acd8bc0677bf15, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:53:41,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ebde8adc54be40ce827e3a369e51a7e0 2023-10-29 16:53:41,200 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 84a8952396474e23a191be64d561db60, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:53:41,200 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 386f04664ab94a1fa416cdc0200021ec_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850293 2023-10-29 16:53:41,201 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:41,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/aa462fbfa7f542a198720ecefc2508a8 2023-10-29 16:53:41,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:41,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/efb63345ac8c4b2984281279ce54ae55 2023-10-29 16:53:41,202 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d5508822f84ca2829f2f4f601e48ce to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c7d5508822f84ca2829f2f4f601e48ce 2023-10-29 16:53:41,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/5916bb40c42b48ccbf327a98cd4c057e 2023-10-29 16:53:41,203 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201de5438b692c44db5a31c9d6173cf7c62 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201de5438b692c44db5a31c9d6173cf7c62 2023-10-29 16:53:41,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/1f1f3fa2e5c44262bef65993d6635046 2023-10-29 16:53:41,205 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2513e72dcdf4da6ab81475e4be50777 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b2513e72dcdf4da6ab81475e4be50777 2023-10-29 16:53:41,205 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-29 16:53:41,205 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 16:53:41,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 16:53:41,206 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 16:53:41,206 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:41,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/ff70eebfcf3f4af2a1eba55fa48bf488_SeqId_44_ 2023-10-29 16:53:41,207 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:53:41,208 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8630 sec 2023-10-29 16:53:41,221 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): fa199e7b26b842cefa4b3d2db5685100#family1#compaction#49 average throughput is 12.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:53:41,314 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=253 (was 260), OpenFileDescriptor=601 (was 620), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=182 (was 234), ProcessCount=168 (was 168), AvailableMemoryMB=3146 (was 3193) 2023-10-29 16:53:41,326 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=253, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=182, ProcessCount=168, AvailableMemoryMB=3146 2023-10-29 16:53:41,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:53:41,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:41,330 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:41,331 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-29 16:53:41,332 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:41,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:41,333 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:41,333 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 empty. 2023-10-29 16:53:41,334 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:41,334 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-29 16:53:41,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:41,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:41,673 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/.tmp/family1/23e622a6c91d4aefbc1d55223b6c8880 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/23e622a6c91d4aefbc1d55223b6c8880 2023-10-29 16:53:41,680 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fa199e7b26b842cefa4b3d2db5685100/family1 of fa199e7b26b842cefa4b3d2db5685100 into 23e622a6c91d4aefbc1d55223b6c8880(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:53:41,680 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:53:41,680 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1698598421198; duration=0sec 2023-10-29 16:53:41,680 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:41,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/84a8952396474e23a191be64d561db60, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_] to archive 2023-10-29 16:53:41,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:41,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/36a985802eff45a893acd8bc0677bf15 2023-10-29 16:53:41,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/84a8952396474e23a191be64d561db60 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/84a8952396474e23a191be64d561db60 2023-10-29 16:53:41,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/family1/386f04664ab94a1fa416cdc0200021ec_SeqId_47_ 2023-10-29 16:53:41,746 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:41,748 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4544ad4a3a3c44ac4a93deaee27f85d1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:41,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:42,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:42,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 4544ad4a3a3c44ac4a93deaee27f85d1, disabling compactions & flushes 2023-10-29 16:53:42,159 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. after waiting 0 ms 2023-10-29 16:53:42,159 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,160 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,160 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:42,164 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:42,166 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598422166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598422166"}]},"ts":"1698598422166"} 2023-10-29 16:53:42,169 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:53:42,171 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:42,171 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598422171"}]},"ts":"1698598422171"} 2023-10-29 16:53:42,173 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-29 16:53:42,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, ASSIGN}] 2023-10-29 16:53:42,179 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, ASSIGN 2023-10-29 16:53:42,180 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:42,332 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:42,332 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598422332"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598422332"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598422332"}]},"ts":"1698598422332"} 2023-10-29 16:53:42,336 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:42,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:42,490 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:42,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4544ad4a3a3c44ac4a93deaee27f85d1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,500 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,502 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:42,502 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:42,502 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4544ad4a3a3c44ac4a93deaee27f85d1 columnFamilyName family1 2023-10-29 16:53:42,504 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(310): Store=4544ad4a3a3c44ac4a93deaee27f85d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:42,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:42,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:42,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4544ad4a3a3c44ac4a93deaee27f85d1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58756716, jitterRate=-0.12445670366287231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:42,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:42,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., pid=41, masterSystemTime=1698598422490 2023-10-29 16:53:42,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,515 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:42,516 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:42,516 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598422516"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598422516"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598422516"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598422516"}]},"ts":"1698598422516"} 2023-10-29 16:53:42,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-29 16:53:42,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 183 msec 2023-10-29 16:53:42,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-29 16:53:42,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, ASSIGN in 344 msec 2023-10-29 16:53:42,524 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:42,524 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598422524"}]},"ts":"1698598422524"} 2023-10-29 16:53:42,525 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-29 16:53:42,528 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:42,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2000 sec 2023-10-29 16:53:43,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 16:53:43,442 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-29 16:53:43,466 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:43,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,467 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:43,467 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:43,467 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:43,467 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:43,468 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,468 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,469 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:43,469 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:43,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:43,469 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:43,469 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,469 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:43,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,470 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,470 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:43,470 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:43,470 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:43,470 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:43,470 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:43,470 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:43,470 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:43,470 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:43,471 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:53:43,888 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309a7f2e2d1c3745fc9582f609a36388e6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309a7f2e2d1c3745fc9582f609a36388e6 2023-10-29 16:53:44,292 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/06b83a25c8104f1dbd1e6a246eea5586 2023-10-29 16:53:44,297 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/06b83a25c8104f1dbd1e6a246eea5586 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586 2023-10-29 16:53:44,302 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-29 16:53:44,303 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 832ms, sequenceid=5, compaction requested=false 2023-10-29 16:53:44,303 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:44,303 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:44,303 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:44,303 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:44,303 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:44,303 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,303 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:44,304 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:44,305 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:44,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,305 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:44,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:44,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:44,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@668036d4[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:44,307 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:44,307 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,307 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,307 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:44,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:44,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:44,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:44,308 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:44,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:44,308 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:44,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:44,310 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:44,310 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:44,310 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:44,310 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,310 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:44,311 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,311 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,312 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:44,312 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:44,312 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,313 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:44,315 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:44,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:44,315 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:44,315 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,315 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,315 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,316 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,316 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:44,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:44,316 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:44,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:44,416 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:44,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:44,420 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,422 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:44,422 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:44,422 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:44,422 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:44,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,423 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:44,423 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:44,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:44,424 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:44,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:44,425 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:44,425 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:44,425 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:53:44,840 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112869e9e9cfa5ef48b3ad17cc3c29fb3768 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112869e9e9cfa5ef48b3ad17cc3c29fb3768 2023-10-29 16:53:45,246 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/132966a8594d435980128fae0a416f9b 2023-10-29 16:53:45,251 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/132966a8594d435980128fae0a416f9b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b 2023-10-29 16:53:45,255 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:53:45,256 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 831ms, sequenceid=9, compaction requested=false 2023-10-29 16:53:45,256 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:45,256 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:45,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:45,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:45,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:45,256 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:45,257 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,257 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:45,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:45,257 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,257 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32efdfb9[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:45,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:45,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,259 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,259 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:45,259 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,260 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:45,259 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:45,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:45,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:45,260 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:45,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:45,260 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:45,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:45,262 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:45,262 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:45,262 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:45,262 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,263 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:45,263 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,263 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:45,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:45,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:45,264 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,265 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:45,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:45,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,268 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,268 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:45,267 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:45,268 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:45,267 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:45,267 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:45,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:45,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:45,268 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:45,268 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:45,368 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:45,373 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:45,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:45,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,375 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:45,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:45,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:45,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:45,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,375 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,376 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,376 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:45,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:45,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:45,376 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:45,376 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:45,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:45,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,377 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,377 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:45,377 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:45,377 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:45,377 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:45,377 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:45,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:45,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:45,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:45,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:45,378 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:45,794 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ca316b9631ce4d82b30906613c79b122 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca316b9631ce4d82b30906613c79b122 2023-10-29 16:53:46,200 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/fcc1b7c0a91e48aaa6052f91c2aecc27 2023-10-29 16:53:46,204 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/fcc1b7c0a91e48aaa6052f91c2aecc27 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27 2023-10-29 16:53:46,208 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 16:53:46,209 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 831ms, sequenceid=13, compaction requested=true 2023-10-29 16:53:46,209 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:46,209 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:46,209 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:46,209 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:46,209 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,209 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:46,209 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:46,210 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,210 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:46,211 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,211 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:46,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:46,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ff63731[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:46,212 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:46,212 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,213 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,213 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:46,213 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:46,213 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:46,213 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,213 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:46,213 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,213 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:46,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:46,214 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:46,214 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:46,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:46,216 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:46,216 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:46,216 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:46,216 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,216 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:46,217 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:46,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:46,217 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,218 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:46,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:46,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:46,220 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:46,220 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:46,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,220 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:46,320 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:46,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:46,325 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:46,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:46,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,327 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:46,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:46,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:46,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:46,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,328 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:46,328 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:46,328 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:46,328 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:46,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:46,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,329 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,329 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:46,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:46,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:46,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:46,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:46,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:46,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:46,329 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:46,329 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:46,330 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:46,741 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120582d8e194019e467f870140a7a0790e03 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120582d8e194019e467f870140a7a0790e03 2023-10-29 16:53:47,147 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/a1b2ae4d38c14964a848660a61bb54c1 2023-10-29 16:53:47,152 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/a1b2ae4d38c14964a848660a61bb54c1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1 2023-10-29 16:53:47,156 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 16:53:47,157 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 828ms, sequenceid=17, compaction requested=true 2023-10-29 16:53:47,157 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:47,157 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:47,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:47,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:47,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:47,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:47,158 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35e78b2[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:47,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:47,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,160 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:47,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:47,160 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:47,161 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:47,161 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,161 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,161 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:47,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:47,163 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:47,163 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:47,163 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:47,163 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,163 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:47,164 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,164 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,165 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,165 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:47,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,165 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:47,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:47,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:47,167 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:47,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:47,167 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:47,268 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:47,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:47,272 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:47,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:47,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,274 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:47,274 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:47,274 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:47,274 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:47,275 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,275 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,275 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:47,275 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:47,276 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,276 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,276 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,277 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:47,277 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,277 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:47,277 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:47,277 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:47,277 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:47,277 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:47,277 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:47,277 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:47,277 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:47,698 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c90a9dbb33ff4972bf965c327a80f2d5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c90a9dbb33ff4972bf965c327a80f2d5 2023-10-29 16:53:47,703 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/3e8d02b5dcef491783f98f60f7f90f3c 2023-10-29 16:53:47,709 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/3e8d02b5dcef491783f98f60f7f90f3c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c 2023-10-29 16:53:47,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 16:53:47,715 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 438ms, sequenceid=21, compaction requested=true 2023-10-29 16:53:47,715 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:47,715 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:47,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:47,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:47,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:47,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:47,717 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,717 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:47,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:47,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@648fd89b[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:47,720 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:47,720 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,720 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:47,721 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,721 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:47,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:47,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:47,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:47,724 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:47,724 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:47,724 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:47,724 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,724 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:47,725 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,725 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,725 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:47,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:47,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,726 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,727 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:47,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:47,728 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:47,728 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,729 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,728 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:47,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:47,729 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:47,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:47,729 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:47,829 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:47,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:47,834 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:47,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,837 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:47,837 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:47,837 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:47,837 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:47,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,838 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,838 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:47,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:47,839 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:47,839 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,840 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:47,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:47,840 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:47,840 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:47,840 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:47,840 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:47,840 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:47,840 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:47,840 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:47,840 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:48,041 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:53:48,257 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313db8e31fb5e146daab290fb2a4adbbfc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313db8e31fb5e146daab290fb2a4adbbfc 2023-10-29 16:53:48,491 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-10-29 16:53:48,663 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/3d8ac3074ffe45ae8e36a92f3323be79 2023-10-29 16:53:48,668 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/3d8ac3074ffe45ae8e36a92f3323be79 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79 2023-10-29 16:53:48,672 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 16:53:48,673 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 833ms, sequenceid=25, compaction requested=true 2023-10-29 16:53:48,673 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:48,673 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:48,673 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:48,673 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:48,673 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,673 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:48,673 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:48,674 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,674 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:48,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:48,674 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,675 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28d1c1a4[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:48,676 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:48,676 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,676 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:48,677 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,677 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:48,677 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,677 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:48,678 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:48,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:48,680 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:48,680 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:48,680 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:48,680 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:48,680 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,680 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:48,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:48,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,681 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:48,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:48,682 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:48,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,684 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,684 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:48,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:48,684 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:48,685 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:48,785 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:48,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:48,790 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:48,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:48,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,791 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:48,791 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:48,791 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:48,791 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:48,792 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,792 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,793 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:48,793 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:48,793 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:48,793 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:48,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:48,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,794 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:48,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:48,794 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:48,794 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:48,794 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:48,794 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:48,794 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:48,794 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:48,794 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:48,794 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:49,209 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d772d3d04c5b41c29a48389d9d0ea515 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d772d3d04c5b41c29a48389d9d0ea515 2023-10-29 16:53:49,617 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/dfc23ce84b2d4da5acc2055228d2b456 2023-10-29 16:53:49,627 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/dfc23ce84b2d4da5acc2055228d2b456 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456 2023-10-29 16:53:49,634 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 16:53:49,635 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 841ms, sequenceid=29, compaction requested=true 2023-10-29 16:53:49,635 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:49,635 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:49,637 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:49,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:49,639 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66502430[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:49,639 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:49,639 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,640 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:49,640 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,640 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:49,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:49,642 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:49,642 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:49,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,642 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:49,644 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:49,644 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:49,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:49,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:49,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:49,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:49,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:49,646 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:49,646 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,647 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,648 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:49,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:49,648 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:49,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:49,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,648 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:49,748 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:49,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:49,753 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:49,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:49,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,755 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,756 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:49,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:49,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:49,757 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:49,757 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,757 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,758 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:49,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:49,758 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:49,758 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:49,758 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:49,758 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:49,758 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:49,758 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:49,758 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:49,758 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:50,180 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103eeee7a5a358a413c8a9e99fbbb2c5069 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103eeee7a5a358a413c8a9e99fbbb2c5069 2023-10-29 16:53:50,591 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/a61129483e5c4299b658913f3c1f91d7 2023-10-29 16:53:50,606 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/a61129483e5c4299b658913f3c1f91d7 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7 2023-10-29 16:53:50,612 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 16:53:50,613 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 855ms, sequenceid=33, compaction requested=true 2023-10-29 16:53:50,613 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:50,613 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:50,613 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:50,615 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,615 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:50,615 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,615 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:50,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:50,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:50,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@163b5ba0[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:50,617 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:50,617 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,618 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,618 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:50,618 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:50,619 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:50,619 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,619 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:50,620 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:50,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:50,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:50,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:50,624 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:50,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:50,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:50,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,624 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:50,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:50,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:50,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:50,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:50,629 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:50,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,642 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:50,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:50,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:50,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:50,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:50,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:50,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:50,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:50,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:50,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:50,643 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,743 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:50,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:50,753 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:50,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:50,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,756 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:50,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:50,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:50,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:50,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,756 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,758 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:50,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:50,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:50,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:50,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,759 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:50,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,760 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,760 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:50,760 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:50,760 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:50,760 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:50,760 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:50,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:50,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:50,761 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:50,761 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:50,761 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:51,182 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f73650e0ac0248be84d1be756935739c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907f73650e0ac0248be84d1be756935739c 2023-10-29 16:53:51,591 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2 2023-10-29 16:53:51,606 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2 2023-10-29 16:53:51,612 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 16:53:51,613 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 852ms, sequenceid=37, compaction requested=true 2023-10-29 16:53:51,613 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:51,613 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:51,615 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:51,615 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:51,616 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,616 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:51,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cea02fc[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:51,618 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:51,618 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,619 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,619 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:51,619 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:51,619 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,619 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:51,619 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:51,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:51,620 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:51,620 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:51,623 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:51,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:51,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:51,624 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,624 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:51,625 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:51,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:51,625 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,626 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:51,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:51,628 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:51,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 16:53:51,628 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:51,629 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:51,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,629 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,629 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,629 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:51,729 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:51,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:51,739 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:51,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 16:53:51,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,744 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:51,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:51,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 16:53:51,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 16:53:51,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,747 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:51,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:51,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:51,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:51,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:51,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:51,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,750 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 16:53:51,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:51,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 16:53:51,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:51,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 16:53:51,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:51,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:51,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:51,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. started... 2023-10-29 16:53:51,750 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4544ad4a3a3c44ac4a93deaee27f85d1 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:53:52,165 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120689293ad090748f3af6a7244953dd6c8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120689293ad090748f3af6a7244953dd6c8 2023-10-29 16:53:52,573 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0 2023-10-29 16:53:52,584 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0 2023-10-29 16:53:52,589 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 16:53:52,590 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 4544ad4a3a3c44ac4a93deaee27f85d1 in 840ms, sequenceid=41, compaction requested=true 2023-10-29 16:53:52,590 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:52,590 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:52,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:53:52,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:53:52,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 16:53:52,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 16:53:52,592 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,592 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:52,592 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,592 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:53:52,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:52,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 16:53:52,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a103e24[Count = 0] remaining members to acquire global barrier 2023-10-29 16:53:52,594 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 16:53:52,594 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,595 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,595 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 16:53:52,595 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 16:53:52,595 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:53:52,595 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,595 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:53:52,596 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 16:53:52,596 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:52,596 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,596 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 16:53:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:52,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:52,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:53:52,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 16:53:52,600 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 16:53:52,600 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:53:52,600 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:53:52,600 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,600 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:53:52,601 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,601 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:53:52,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,601 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:53:52,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:52,602 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,604 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:53:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 16:53:52,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,606 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:53:52,606 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:53:52,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:52,607 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 16:53:52,607 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:53:52,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:53:52,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:53:52,707 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:53:52,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:53:52,712 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:52,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:52,716 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:52,717 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:52,717 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599032717 2023-10-29 16:53:52,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:52,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 16:53:52,720 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:52,722 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x4b75bc74 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:52,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ab7fd59, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:52,725 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,579 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038a6b772fd80f476dabdb1fcf88988bcf to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038a6b772fd80f476dabdb1fcf88988bcf 2023-10-29 16:53:53,581 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:53,595 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:53,597 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:53,603 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:53,605 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:53,615 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/143d0e1bd803452db7b3eb89f208b275 first=Optional[r3] last=Optional[r6] 2023-10-29 16:53:53,616 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/143d0e1bd803452db7b3eb89f208b275}] 2023-10-29 16:53:53,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/143d0e1bd803452db7b3eb89f208b275 for inclusion in 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:53,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 16:53:53,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:53,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:53,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/143d0e1bd803452db7b3eb89f208b275 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2dtrudchqun52b2tg0o71if1sdcnq7cler3g112o3ca66g74fl1c2lc8u2fmqb3s/family1/143d0e1bd803452db7b3eb89f208b275 2023-10-29 16:53:53,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2dtrudchqun52b2tg0o71if1sdcnq7cler3g112o3ca66g74fl1c2lc8u2fmqb3s/family1/143d0e1bd803452db7b3eb89f208b275 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_ 2023-10-29 16:53:53,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2dtrudchqun52b2tg0o71if1sdcnq7cler3g112o3ca66g74fl1c2lc8u2fmqb3s/family1/143d0e1bd803452db7b3eb89f208b275 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_ - updating store file list. 2023-10-29 16:53:53,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_ into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:53,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2dtrudchqun52b2tg0o71if1sdcnq7cler3g112o3ca66g74fl1c2lc8u2fmqb3s/family1/143d0e1bd803452db7b3eb89f208b275 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_) 2023-10-29 16:53:53,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__2dtrudchqun52b2tg0o71if1sdcnq7cler3g112o3ca66g74fl1c2lc8u2fmqb3s/family1/143d0e1bd803452db7b3eb89f208b275 2023-10-29 16:53:53,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:53:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:53:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 4544ad4a3a3c44ac4a93deaee27f85d1/family1 is initiating minor compaction 2023-10-29 16:53:53,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fc14549; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:53,633 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4544ad4a3a3c44ac4a93deaee27f85d1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:53,633 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp, totalSize=50.4 K 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 132966a8594d435980128fae0a416f9b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting fcc1b7c0a91e48aaa6052f91c2aecc27, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting a1b2ae4d38c14964a848660a61bb54c1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 3e8d02b5dcef491783f98f60f7f90f3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 3d8ac3074ffe45ae8e36a92f3323be79, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting dfc23ce84b2d4da5acc2055228d2b456, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting a61129483e5c4299b658913f3c1f91d7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 556fbc198d8d4a1ba6d02c7dbde9c7d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 85818c33fd3f4ae7b18c2e2c8bd6e8d0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:53:53,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:53:53,635 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:53,636 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:53,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c90a9dbb33ff4972bf965c327a80f2d5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228c90a9dbb33ff4972bf965c327a80f2d5 2023-10-29 16:53:53,639 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313db8e31fb5e146daab290fb2a4adbbfc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313db8e31fb5e146daab290fb2a4adbbfc 2023-10-29 16:53:53,641 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d772d3d04c5b41c29a48389d9d0ea515 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101d772d3d04c5b41c29a48389d9d0ea515 2023-10-29 16:53:53,642 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103eeee7a5a358a413c8a9e99fbbb2c5069 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103eeee7a5a358a413c8a9e99fbbb2c5069 2023-10-29 16:53:53,642 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-29 16:53:53,642 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:53,660 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4544ad4a3a3c44ac4a93deaee27f85d1#family1#compaction#60 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:53:54,484 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/6b4ce1c259bd4db6ba0be139fe21ed94 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/6b4ce1c259bd4db6ba0be139fe21ed94 2023-10-29 16:53:54,489 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055a87625622474d40ad26feb488245c85 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055a87625622474d40ad26feb488245c85 2023-10-29 16:53:54,490 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:54,490 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 4544ad4a3a3c44ac4a93deaee27f85d1/family1 of 4544ad4a3a3c44ac4a93deaee27f85d1 into 6b4ce1c259bd4db6ba0be139fe21ed94(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:53:54,490 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:54,490 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698598433633; duration=0sec 2023-10-29 16:53:54,490 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:54,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_] to archive 2023-10-29 16:53:54,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:54,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/132966a8594d435980128fae0a416f9b 2023-10-29 16:53:54,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/fcc1b7c0a91e48aaa6052f91c2aecc27 2023-10-29 16:53:54,513 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a1b2ae4d38c14964a848660a61bb54c1 2023-10-29 16:53:54,515 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3e8d02b5dcef491783f98f60f7f90f3c 2023-10-29 16:53:54,517 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/3d8ac3074ffe45ae8e36a92f3323be79 2023-10-29 16:53:54,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dfc23ce84b2d4da5acc2055228d2b456 2023-10-29 16:53:54,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/a61129483e5c4299b658913f3c1f91d7 2023-10-29 16:53:54,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/556fbc198d8d4a1ba6d02c7dbde9c7d2 2023-10-29 16:53:54,522 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1290863014c94574a4d3a4d00bb830e5 first=Optional[r00] last=Optional[r2] 2023-10-29 16:53:54,523 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1290863014c94574a4d3a4d00bb830e5}] 2023-10-29 16:53:54,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/85818c33fd3f4ae7b18c2e2c8bd6e8d0 2023-10-29 16:53:54,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1290863014c94574a4d3a4d00bb830e5 for inclusion in 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:54,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/5b70894c2a2e4bdfa3a5a0c5014dd467_SeqId_44_ 2023-10-29 16:53:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 16:53:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:54,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:54,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1290863014c94574a4d3a4d00bb830e5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vko7rdmfmlkbodnnj9ejm9ad8t8kqkla6cpn67mqj7qeblcd3ska78kljq1hplhd/family1/1290863014c94574a4d3a4d00bb830e5 2023-10-29 16:53:54,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vko7rdmfmlkbodnnj9ejm9ad8t8kqkla6cpn67mqj7qeblcd3ska78kljq1hplhd/family1/1290863014c94574a4d3a4d00bb830e5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_ 2023-10-29 16:53:54,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vko7rdmfmlkbodnnj9ejm9ad8t8kqkla6cpn67mqj7qeblcd3ska78kljq1hplhd/family1/1290863014c94574a4d3a4d00bb830e5 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_ - updating store file list. 2023-10-29 16:53:54,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_ into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:54,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vko7rdmfmlkbodnnj9ejm9ad8t8kqkla6cpn67mqj7qeblcd3ska78kljq1hplhd/family1/1290863014c94574a4d3a4d00bb830e5 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_) 2023-10-29 16:53:54,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vko7rdmfmlkbodnnj9ejm9ad8t8kqkla6cpn67mqj7qeblcd3ska78kljq1hplhd/family1/1290863014c94574a4d3a4d00bb830e5 2023-10-29 16:53:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:53:54,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:53:54,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 4544ad4a3a3c44ac4a93deaee27f85d1/family1 is initiating minor compaction (all files) 2023-10-29 16:53:54,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@159373f4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:54,540 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 4544ad4a3a3c44ac4a93deaee27f85d1/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:54,540 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/6b4ce1c259bd4db6ba0be139fe21ed94, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp, totalSize=390.1 K 2023-10-29 16:53:54,540 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 06b83a25c8104f1dbd1e6a246eea5586, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:53:54,541 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 6b4ce1c259bd4db6ba0be139fe21ed94, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:53:54,541 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 4e03a06953b94f4facb0f1222694d0d0_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850293 2023-10-29 16:53:54,541 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:54,542 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:54,544 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309a7f2e2d1c3745fc9582f609a36388e6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511309a7f2e2d1c3745fc9582f609a36388e6 2023-10-29 16:53:54,545 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca316b9631ce4d82b30906613c79b122 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ca316b9631ce4d82b30906613c79b122 2023-10-29 16:53:54,546 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120582d8e194019e467f870140a7a0790e03 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120582d8e194019e467f870140a7a0790e03 2023-10-29 16:53:54,546 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-29 16:53:54,546 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 16:53:54,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:54,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:54,547 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:54,548 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:54,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.8350 sec 2023-10-29 16:53:54,557 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4544ad4a3a3c44ac4a93deaee27f85d1#family1#compaction#61 average throughput is 30.10 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:53:54,632 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 16:53:54,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:55,043 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 16:53:55,044 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:55,044 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 16:53:55,046 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 16:53:55,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE}] 2023-10-29 16:53:55,049 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE 2023-10-29 16:53:55,049 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:55,049 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598435049"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598435049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598435049"}]},"ts":"1698598435049"} 2023-10-29 16:53:55,051 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:55,202 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:55,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:55,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4544ad4a3a3c44ac4a93deaee27f85d1, disabling compactions & flushes 2023-10-29 16:53:55,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:55,799 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/.tmp/family1/dcc14cf8f3044ec3a98bc65212a569b5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dcc14cf8f3044ec3a98bc65212a569b5 2023-10-29 16:53:55,806 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 4544ad4a3a3c44ac4a93deaee27f85d1/family1 of 4544ad4a3a3c44ac4a93deaee27f85d1 into dcc14cf8f3044ec3a98bc65212a569b5(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:53:55,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. after waiting 0 ms 2023-10-29 16:53:55,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:55,806 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:55,806 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698598434539; duration=1sec 2023-10-29 16:53:55,806 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:53:55,807 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/6b4ce1c259bd4db6ba0be139fe21ed94, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_] to archive 2023-10-29 16:53:55,808 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:55,809 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/06b83a25c8104f1dbd1e6a246eea5586 2023-10-29 16:53:55,810 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/6b4ce1c259bd4db6ba0be139fe21ed94 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/6b4ce1c259bd4db6ba0be139fe21ed94 2023-10-29 16:53:55,811 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/4e03a06953b94f4facb0f1222694d0d0_SeqId_47_ 2023-10-29 16:53:55,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 16:53:55,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:55,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:55,817 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 4544ad4a3a3c44ac4a93deaee27f85d1 to self. 2023-10-29 16:53:55,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:55,819 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=CLOSED 2023-10-29 16:53:55,819 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598435819"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598435819"}]},"ts":"1698598435819"} 2023-10-29 16:53:55,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-29 16:53:55,821 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 769 msec 2023-10-29 16:53:55,822 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=true 2023-10-29 16:53:55,972 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:55,972 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598435972"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598435972"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598435972"}]},"ts":"1698598435972"} 2023-10-29 16:53:55,974 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:56,125 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:56,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:56,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4544ad4a3a3c44ac4a93deaee27f85d1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:56,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:56,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,129 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,130 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:56,130 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:56,131 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4544ad4a3a3c44ac4a93deaee27f85d1 columnFamilyName family1 2023-10-29 16:53:56,135 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dcc14cf8f3044ec3a98bc65212a569b5 2023-10-29 16:53:56,136 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(310): Store=4544ad4a3a3c44ac4a93deaee27f85d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:56,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:56,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4544ad4a3a3c44ac4a93deaee27f85d1; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65279902, jitterRate=-0.027253657579421997}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:56,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:56,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., pid=47, masterSystemTime=1698598436125 2023-10-29 16:53:56,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:56,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:56,142 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:56,142 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598436142"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598436142"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598436142"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598436142"}]},"ts":"1698598436142"} 2023-10-29 16:53:56,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-29 16:53:56,145 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 169 msec 2023-10-29 16:53:56,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-29 16:53:56,146 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE in 1.0970 sec 2023-10-29 16:53:56,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-29 16:53:56,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1010 sec 2023-10-29 16:53:56,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5170 sec 2023-10-29 16:53:56,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-29 16:53:56,152 INFO [Listener at localhost/45209] compactions.TestMobCompactor(278): alter status finished 2023-10-29 16:53:56,153 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:56,154 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:56,155 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:56,156 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:56,156 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599036156 2023-10-29 16:53:56,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:56,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 16:53:56,157 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:56,159 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x390b2fd9 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:56,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cb34094, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:56,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,600 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d2ff964025e54e6c94a3ff3c2498f6eb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2ff964025e54e6c94a3ff3c2498f6eb 2023-10-29 16:53:56,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:56,615 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:53:56,617 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:53:56,625 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:53:56,631 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:53:56,645 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4070e38844924834b919f5fd37799aa5 first=Optional[r05] last=Optional[r8] 2023-10-29 16:53:56,646 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4070e38844924834b919f5fd37799aa5}] 2023-10-29 16:53:56,655 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4070e38844924834b919f5fd37799aa5 for inclusion in 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:56,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 16:53:56,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:53:56,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:56,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4070e38844924834b919f5fd37799aa5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vrc0u4q8ahtpgl44702k0n9c5pb5s9bjhm1i75vpt188chaq6su648vqf2h7rhgn/family1/4070e38844924834b919f5fd37799aa5 2023-10-29 16:53:56,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vrc0u4q8ahtpgl44702k0n9c5pb5s9bjhm1i75vpt188chaq6su648vqf2h7rhgn/family1/4070e38844924834b919f5fd37799aa5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/607f730f66744456b44ec23e23df2f55_SeqId_53_ 2023-10-29 16:53:56,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vrc0u4q8ahtpgl44702k0n9c5pb5s9bjhm1i75vpt188chaq6su648vqf2h7rhgn/family1/4070e38844924834b919f5fd37799aa5 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/607f730f66744456b44ec23e23df2f55_SeqId_53_ - updating store file list. 2023-10-29 16:53:56,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/607f730f66744456b44ec23e23df2f55_SeqId_53_ into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:56,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vrc0u4q8ahtpgl44702k0n9c5pb5s9bjhm1i75vpt188chaq6su648vqf2h7rhgn/family1/4070e38844924834b919f5fd37799aa5 into 4544ad4a3a3c44ac4a93deaee27f85d1/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/607f730f66744456b44ec23e23df2f55_SeqId_53_) 2023-10-29 16:53:56,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__vrc0u4q8ahtpgl44702k0n9c5pb5s9bjhm1i75vpt188chaq6su648vqf2h7rhgn/family1/4070e38844924834b919f5fd37799aa5 2023-10-29 16:53:56,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:56,676 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:53:56,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120689293ad090748f3af6a7244953dd6c8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120689293ad090748f3af6a7244953dd6c8 2023-10-29 16:53:56,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112869e9e9cfa5ef48b3ad17cc3c29fb3768 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015112869e9e9cfa5ef48b3ad17cc3c29fb3768 2023-10-29 16:53:56,680 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-29 16:53:56,680 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 16:53:56,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,681 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:56,681 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:56,681 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:56,683 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:56,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 529 msec 2023-10-29 16:53:56,764 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:53:56,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:57,188 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 16:53:57,189 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 16:53:57,189 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 16:53:57,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 16:53:57,194 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE}] 2023-10-29 16:53:57,194 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE 2023-10-29 16:53:57,195 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:57,195 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598437195"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598437195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598437195"}]},"ts":"1698598437195"} 2023-10-29 16:53:57,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:57,348 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:57,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4544ad4a3a3c44ac4a93deaee27f85d1, disabling compactions & flushes 2023-10-29 16:53:57,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. after waiting 0 ms 2023-10-29 16:53:57,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 16:53:57,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,363 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:57,363 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 4544ad4a3a3c44ac4a93deaee27f85d1 to self. 2023-10-29 16:53:57,365 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=CLOSED 2023-10-29 16:53:57,366 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598437365"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598437365"}]},"ts":"1698598437365"} 2023-10-29 16:53:57,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-29 16:53:57,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 170 msec 2023-10-29 16:53:57,370 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=true 2023-10-29 16:53:57,520 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:57,521 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598437520"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598437520"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598437520"}]},"ts":"1698598437520"} 2023-10-29 16:53:57,524 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:57,678 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:57,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4544ad4a3a3c44ac4a93deaee27f85d1, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,684 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,685 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:57,685 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1 2023-10-29 16:53:57,685 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4544ad4a3a3c44ac4a93deaee27f85d1 columnFamilyName family1 2023-10-29 16:53:57,691 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/607f730f66744456b44ec23e23df2f55_SeqId_53_ 2023-10-29 16:53:57,694 DEBUG [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/family1/dcc14cf8f3044ec3a98bc65212a569b5 2023-10-29 16:53:57,695 INFO [StoreOpener-4544ad4a3a3c44ac4a93deaee27f85d1-1] regionserver.HStore(310): Store=4544ad4a3a3c44ac4a93deaee27f85d1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:57,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:53:57,701 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4544ad4a3a3c44ac4a93deaee27f85d1; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62522503, jitterRate=-0.06834210455417633}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:57,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:53:57,702 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1., pid=53, masterSystemTime=1698598437678 2023-10-29 16:53:57,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,704 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:53:57,704 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=4544ad4a3a3c44ac4a93deaee27f85d1, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:57,704 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698598437704"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598437704"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598437704"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598437704"}]},"ts":"1698598437704"} 2023-10-29 16:53:57,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-29 16:53:57,707 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 4544ad4a3a3c44ac4a93deaee27f85d1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 181 msec 2023-10-29 16:53:57,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-29 16:53:57,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=4544ad4a3a3c44ac4a93deaee27f85d1, REOPEN/MOVE in 513 msec 2023-10-29 16:53:57,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-29 16:53:57,710 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 517 msec 2023-10-29 16:53:57,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 945 msec 2023-10-29 16:53:57,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-29 16:53:57,713 INFO [Listener at localhost/45209] compactions.TestMobCompactor(278): alter status finished 2023-10-29 16:53:57,714 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 16:53:57,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:57,716 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:57,717 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:57,717 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599037717 2023-10-29 16:53:57,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:53:57,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 16:53:57,719 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:57,720 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x367919cd to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:53:57,723 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70884876, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:53:57,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 16:53:57,724 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 16:53:57,724 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:53:57,725 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 16:53:57,726 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 10 msec 2023-10-29 16:53:57,775 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=246 (was 253), OpenFileDescriptor=619 (was 601) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=179 (was 182), ProcessCount=170 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=2879 (was 3146) 2023-10-29 16:53:57,784 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=246, OpenFileDescriptor=619, MaxFileDescriptor=60000, SystemLoadAverage=179, ProcessCount=170, AvailableMemoryMB=2878 2023-10-29 16:53:57,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 16:53:57,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:57,789 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:53:57,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-29 16:53:57,790 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:53:57,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:57,792 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:57,792 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c empty. 2023-10-29 16:53:57,793 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:57,793 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-29 16:53:57,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:58,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:58,205 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 16:53:58,206 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff824f34119091986d5f8c31d6248d2c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:53:58,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing ff824f34119091986d5f8c31d6248d2c, disabling compactions & flushes 2023-10-29 16:53:58,613 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. after waiting 0 ms 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,613 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,613 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:53:58,615 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:53:58,616 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598438616"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598438616"}]},"ts":"1698598438616"} 2023-10-29 16:53:58,617 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:53:58,618 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:53:58,618 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598438618"}]},"ts":"1698598438618"} 2023-10-29 16:53:58,619 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-29 16:53:58,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, ASSIGN}] 2023-10-29 16:53:58,622 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, ASSIGN 2023-10-29 16:53:58,623 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:53:58,774 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:58,774 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598438774"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598438774"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598438774"}]},"ts":"1698598438774"} 2023-10-29 16:53:58,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:53:58,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:58,928 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:58,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff824f34119091986d5f8c31d6248d2c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:53:58,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:53:58,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,932 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,935 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:53:58,935 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:53:58,935 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff824f34119091986d5f8c31d6248d2c columnFamilyName family1 2023-10-29 16:53:58,937 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(310): Store=ff824f34119091986d5f8c31d6248d2c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:53:58,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:53:58,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:53:58,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ff824f34119091986d5f8c31d6248d2c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69364798, jitterRate=0.03361603617668152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:53:58,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:53:58,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., pid=57, masterSystemTime=1698598438928 2023-10-29 16:53:58,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:58,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:58,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598438948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598438948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598438948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598438948"}]},"ts":"1698598438948"} 2023-10-29 16:53:58,950 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-29 16:53:58,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 173 msec 2023-10-29 16:53:58,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-29 16:53:58,952 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, ASSIGN in 330 msec 2023-10-29 16:53:58,953 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:53:58,953 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598438953"}]},"ts":"1698598438953"} 2023-10-29 16:53:58,954 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-29 16:53:58,956 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:53:58,957 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1690 sec 2023-10-29 16:53:59,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 16:53:59,897 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-29 16:53:59,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:53:59,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,925 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:53:59,925 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:59,925 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:53:59,925 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:53:59,926 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,926 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,926 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:59,926 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:53:59,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:53:59,927 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:53:59,927 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,927 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:53:59,927 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:53:59,928 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:53:59,928 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:53:59,928 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:53:59,928 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:53:59,928 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:53:59,928 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:53:59,929 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:54:00,345 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511308442e9c8caba40c584f58486655085b5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308442e9c8caba40c584f58486655085b5 2023-10-29 16:54:00,456 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:00,750 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/7999f97c26294e54b8efb85b2381e5b7 2023-10-29 16:54:00,755 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/7999f97c26294e54b8efb85b2381e5b7 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7 2023-10-29 16:54:00,760 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-29 16:54:00,761 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 832ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:00,761 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:00,761 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:00,761 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:00,763 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,763 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:00,763 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,763 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:00,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:00,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:00,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d86eef2[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:00,764 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:00,764 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,765 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,765 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:00,765 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:00,765 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:00,765 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,765 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:00,766 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:00,766 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,766 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:00,766 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:00,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:00,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:00,768 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:00,768 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:00,768 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:00,768 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,768 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:00,769 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:00,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:00,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:00,769 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,770 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,772 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,772 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:00,772 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:00,772 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:00,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:00,773 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:00,772 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:00,772 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:00,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:00,773 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:00,873 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:00,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:00,878 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:00,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:00,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,880 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:00,880 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:00,880 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:00,880 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:00,881 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,881 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,881 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:00,881 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:00,882 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:00,882 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,882 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,883 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:00,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:00,883 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:00,883 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:00,883 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:00,883 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:00,883 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:00,883 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:00,883 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:00,883 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:54:01,306 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284352bbd3211749d68b393758b38911a1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284352bbd3211749d68b393758b38911a1 2023-10-29 16:54:01,362 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:01,718 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/5c6cfffc714644f99e2a4167d6174e67 2023-10-29 16:54:01,730 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/5c6cfffc714644f99e2a4167d6174e67 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67 2023-10-29 16:54:01,737 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:54:01,738 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 855ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:01,739 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:01,739 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:01,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:01,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:01,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:01,739 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:01,741 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,741 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:01,741 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,741 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:01,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:01,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:01,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12c4ab9[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:01,743 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:01,743 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,744 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:01,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:01,744 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:01,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:01,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,745 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:01,745 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:01,745 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:01,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:01,747 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:01,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:01,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:01,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,747 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:01,748 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,748 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:01,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,748 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:01,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:01,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:01,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:01,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,750 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:01,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:01,751 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:01,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:01,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:01,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,751 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:01,752 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:01,751 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:01,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:01,752 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:01,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:01,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:01,852 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:01,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:01,862 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:01,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:01,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,864 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:01,864 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:01,865 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:01,865 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:01,865 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,865 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,866 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:01,866 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:01,867 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:01,867 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:01,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,868 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,869 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,869 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:01,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:01,869 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:01,869 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:01,869 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:01,870 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:01,870 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:01,870 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:01,870 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:01,870 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:02,293 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d106a4f4d0fc419ebe3bc9783c21cb5a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d106a4f4d0fc419ebe3bc9783c21cb5a 2023-10-29 16:54:02,701 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/84dfed54e7094277bc2a7f4e576b6cdb 2023-10-29 16:54:02,705 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/84dfed54e7094277bc2a7f4e576b6cdb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb 2023-10-29 16:54:02,709 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 16:54:02,710 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 840ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:02,710 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:02,710 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:02,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:02,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:02,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:02,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:02,712 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,712 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:02,712 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,712 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:02,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:02,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d8d4582[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:02,713 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:02,714 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,714 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,714 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:02,714 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:02,714 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:02,714 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,715 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:02,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:02,715 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:02,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:02,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:02,715 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:02,717 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:02,717 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:02,717 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:02,717 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,717 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:02,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:02,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:02,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:02,719 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,719 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,721 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:02,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:02,721 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:02,721 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:02,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:02,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:02,721 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:02,822 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:02,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:02,826 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:02,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,828 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:02,828 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:02,828 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:02,828 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:02,828 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,828 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,829 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:02,829 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:02,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:02,829 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:02,829 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:02,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,830 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,830 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,830 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:02,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:02,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:02,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:02,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:02,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:02,830 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:02,830 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:02,830 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:02,831 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:03,249 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ec925bdb19e94b0ea5f621ad695c5169 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec925bdb19e94b0ea5f621ad695c5169 2023-10-29 16:54:03,656 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/101310895ef34efe9ffa7deb7fde0870 2023-10-29 16:54:03,667 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/101310895ef34efe9ffa7deb7fde0870 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870 2023-10-29 16:54:03,674 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 16:54:03,675 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 844ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:03,675 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:03,675 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:03,676 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:03,676 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:03,676 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,676 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:03,676 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:03,679 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,679 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:03,680 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,680 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:03,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:03,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:03,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76c7a109[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:03,682 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:03,682 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,683 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,683 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:03,684 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:03,684 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,684 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:03,684 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:03,685 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:03,685 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,685 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:03,685 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:03,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:03,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:03,690 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:03,690 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:03,690 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:03,690 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:03,690 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,690 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:03,692 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,692 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:03,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,692 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:03,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:03,693 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:03,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:03,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,695 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:03,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,698 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,698 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:03,699 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:03,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:03,698 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:03,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:03,699 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:03,699 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,699 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:03,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:03,699 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,700 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,700 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,699 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:03,700 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:03,800 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:03,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:03,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:03,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:03,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,814 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:03,814 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:03,814 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:03,814 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:03,815 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,815 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,816 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:03,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:03,816 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,817 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:03,817 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:03,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,818 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:03,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:03,819 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:03,819 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:03,819 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:03,819 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:03,819 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:03,819 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:03,820 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:03,820 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:04,242 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bf01c4ddd24c4632bcf5b15f104b6732 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bf01c4ddd24c4632bcf5b15f104b6732 2023-10-29 16:54:04,651 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/521e11cd41cf40028ceadd32300752e4 2023-10-29 16:54:04,661 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/521e11cd41cf40028ceadd32300752e4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4 2023-10-29 16:54:04,667 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 16:54:04,668 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 848ms, sequenceid=21, compaction requested=true 2023-10-29 16:54:04,668 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:04,668 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:04,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:04,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:04,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:04,668 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:04,670 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,670 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:04,670 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,670 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:04,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:04,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:04,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:04,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ccc205d[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:04,673 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:04,673 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,674 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,674 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:04,674 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:04,674 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:04,674 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,674 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:04,675 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:04,675 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:04,675 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:04,675 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:04,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:04,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:04,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:04,677 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:04,677 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:04,677 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:04,677 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,677 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:04,678 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:04,678 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,678 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:04,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:04,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:04,678 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,679 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,680 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,680 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,680 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,681 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:04,681 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:04,681 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,681 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:04,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:04,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,681 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:04,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:04,781 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:04,787 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:04,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:04,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,789 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:04,789 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:04,789 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:04,789 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:04,789 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,789 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,790 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,790 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:04,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:04,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:04,791 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:04,791 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:04,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,792 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,792 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:04,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:04,792 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:04,792 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:04,792 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:04,792 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:04,793 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:04,793 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:04,793 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:04,793 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:05,211 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231bd1d147329f4469f84f0e4192be4b01d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd1d147329f4469f84f0e4192be4b01d 2023-10-29 16:54:05,619 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/34d9297664c748528645e383bf5ec67a 2023-10-29 16:54:05,632 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/34d9297664c748528645e383bf5ec67a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a 2023-10-29 16:54:05,637 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 16:54:05,638 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 845ms, sequenceid=25, compaction requested=true 2023-10-29 16:54:05,638 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:05,638 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:05,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:05,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:05,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:05,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:05,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,640 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:05,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,640 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:05,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:05,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:05,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:05,642 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:05,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f56caff[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:05,643 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:05,643 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,643 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,644 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:05,644 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:05,644 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:05,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:05,645 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:05,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,645 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:05,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:05,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:05,645 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:05,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:05,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:05,648 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:05,648 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:05,648 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:05,648 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:05,648 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,648 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:05,659 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,659 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:05,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,659 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:05,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:05,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:05,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:05,660 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:05,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,663 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:05,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,668 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:05,668 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:05,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:05,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:05,668 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,669 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:05,669 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:05,669 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,669 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,669 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:05,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:05,769 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:05,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:05,775 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:05,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:05,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,776 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:05,777 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:05,777 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:05,777 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:05,777 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,777 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,778 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:05,778 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:05,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:05,779 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:05,779 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,779 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:05,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,779 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,780 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:05,780 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:05,780 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:05,780 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:05,780 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:05,780 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:05,780 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:05,780 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:05,780 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:05,780 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:06,199 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101c4262f591072496ba4eef7ae252cbc3b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4262f591072496ba4eef7ae252cbc3b 2023-10-29 16:54:06,606 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/fb760b6755f043e49edbae020ac0e4ea 2023-10-29 16:54:06,618 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/fb760b6755f043e49edbae020ac0e4ea as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea 2023-10-29 16:54:06,623 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 16:54:06,624 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 844ms, sequenceid=29, compaction requested=true 2023-10-29 16:54:06,624 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:06,624 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:06,625 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,625 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:06,626 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:06,626 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:06,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:06,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@584033c2[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:06,627 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:06,627 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,628 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:06,628 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,628 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:06,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:06,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:06,629 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:06,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:06,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:06,631 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:06,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:06,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:06,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,631 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:06,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:06,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:06,632 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,633 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:06,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:06,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:06,635 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:06,635 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:06,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:06,635 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:06,735 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:06,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:06,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:06,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:06,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,743 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:06,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:06,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:06,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:06,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,744 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:06,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:06,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:06,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:06,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:06,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:06,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:06,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:06,748 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:06,748 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:06,764 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:06,764 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:06,764 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x367919cd to 127.0.0.1:61373 2023-10-29 16:54:06,764 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:06,764 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:06,766 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:06,767 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x459d62e1 to 127.0.0.1:61373 2023-10-29 16:54:06,767 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:06,768 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:06,768 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b75bc74 to 127.0.0.1:61373 2023-10-29 16:54:06,768 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:06,773 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:06,773 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x390b2fd9 to 127.0.0.1:61373 2023-10-29 16:54:06,773 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:06,793 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010367fd146acc0947a1a6d6be51339d3f59 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010367fd146acc0947a1a6d6be51339d3f59 2023-10-29 16:54:07,199 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/e1c5a62b82df4b2e9494112e6ee2688b 2023-10-29 16:54:07,211 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/e1c5a62b82df4b2e9494112e6ee2688b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b 2023-10-29 16:54:07,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 16:54:07,220 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 456ms, sequenceid=33, compaction requested=true 2023-10-29 16:54:07,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:07,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:07,220 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:07,220 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:07,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:07,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:07,222 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,222 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:07,223 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,223 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13c40e2a[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:07,225 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:07,225 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,226 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:07,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:07,226 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:07,226 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,226 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:07,227 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,227 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:07,228 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:07,228 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:07,231 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:07,231 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:07,231 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:07,231 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:07,232 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,232 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:07,233 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,233 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,233 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:07,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:07,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:07,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:07,234 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:07,236 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:07,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:07,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,238 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:07,239 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:07,238 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:07,238 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:07,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,239 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:07,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:07,239 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:07,239 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:07,339 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:07,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:07,352 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:07,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:07,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,354 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:07,354 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:07,354 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:07,354 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:07,355 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,355 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,356 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,356 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:07,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:07,356 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:07,356 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,356 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,357 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:07,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:07,357 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:07,357 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:07,357 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:07,362 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:07,362 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:07,362 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:07,362 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:07,362 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:07,775 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509072dd72b3702894e9694c4cb37cb26f8f8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509072dd72b3702894e9694c4cb37cb26f8f8 2023-10-29 16:54:08,181 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/318aa494dbcb4fbfac4eeb547697e169 2023-10-29 16:54:08,189 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/318aa494dbcb4fbfac4eeb547697e169 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169 2023-10-29 16:54:08,196 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 16:54:08,197 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 835ms, sequenceid=37, compaction requested=true 2023-10-29 16:54:08,197 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:08,197 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:08,199 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:08,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:08,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ee71ac7[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:08,201 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:08,201 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,201 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:08,201 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,201 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:08,202 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:08,205 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:08,205 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:08,205 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:08,205 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,205 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:08,206 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:08,206 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,207 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:08,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:08,209 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:08,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:08,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:08,209 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:08,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:08,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:08,209 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:08,309 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:08,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:08,321 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:08,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:08,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,324 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:08,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:08,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 16:54:08,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 16:54:08,326 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,326 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,327 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:08,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:08,328 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:08,329 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:08,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:08,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,331 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,331 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 16:54:08,331 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:08,331 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 16:54:08,331 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:08,332 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 16:54:08,332 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:54:08,332 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:08,332 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:08,332 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. started... 2023-10-29 16:54:08,332 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff824f34119091986d5f8c31d6248d2c 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:54:08,755 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120104a2f58d2e444caad402f830e325696 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120104a2f58d2e444caad402f830e325696 2023-10-29 16:54:09,164 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/338acdba84104018b42fd2824bc75afa 2023-10-29 16:54:09,177 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/338acdba84104018b42fd2824bc75afa as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa 2023-10-29 16:54:09,184 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 16:54:09,186 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff824f34119091986d5f8c31d6248d2c in 854ms, sequenceid=41, compaction requested=true 2023-10-29 16:54:09,186 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:09,186 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:09,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:54:09,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:54:09,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 16:54:09,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 16:54:09,188 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,188 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:09,189 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,189 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:09,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 16:54:09,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@273f26d6[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:09,192 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 16:54:09,192 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,193 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,193 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 16:54:09,193 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 16:54:09,193 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:09,194 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,194 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:09,195 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 16:54:09,195 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:09,195 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 16:54:09,195 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:09,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:09,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:09,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 16:54:09,200 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 16:54:09,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:09,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:09,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,201 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:09,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,220 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:09,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,221 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:09,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:09,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:09,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:09,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,224 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:09,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:09,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:09,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:09,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:09,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 16:54:09,228 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 16:54:09,229 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:09,228 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:09,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:09,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:09,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:09,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,229 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:09,229 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,230 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:09,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,330 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:09,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:09,335 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:09,338 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:09,339 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:09,340 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599049340 2023-10-29 16:54:09,340 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:09,344 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:54:09,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 16:54:09,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:09,347 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x5abda93c to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:09,351 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e6616ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:09,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,207 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039772135c7273417b9ccc066f5fe2f085 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601039772135c7273417b9ccc066f5fe2f085 2023-10-29 16:54:10,208 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:10,218 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:10,219 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:10,226 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:54:10,227 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:54:10,236 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9860fbd61dd44e5a024dba9a5961925 first=Optional[r3] last=Optional[r6] 2023-10-29 16:54:10,236 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9860fbd61dd44e5a024dba9a5961925}] 2023-10-29 16:54:10,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9860fbd61dd44e5a024dba9a5961925 for inclusion in ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:10,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 16:54:10,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:54:10,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:10,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/a9860fbd61dd44e5a024dba9a5961925 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1a1gg4jmrnfuasbuk6q8bck0buioa9ren94jilkc0j0rle5e2h0lv3l3vcqbkevv/family1/a9860fbd61dd44e5a024dba9a5961925 2023-10-29 16:54:10,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1a1gg4jmrnfuasbuk6q8bck0buioa9ren94jilkc0j0rle5e2h0lv3l3vcqbkevv/family1/a9860fbd61dd44e5a024dba9a5961925 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_ 2023-10-29 16:54:10,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1a1gg4jmrnfuasbuk6q8bck0buioa9ren94jilkc0j0rle5e2h0lv3l3vcqbkevv/family1/a9860fbd61dd44e5a024dba9a5961925 into ff824f34119091986d5f8c31d6248d2c/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_ - updating store file list. 2023-10-29 16:54:10,254 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_ into ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:10,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1a1gg4jmrnfuasbuk6q8bck0buioa9ren94jilkc0j0rle5e2h0lv3l3vcqbkevv/family1/a9860fbd61dd44e5a024dba9a5961925 into ff824f34119091986d5f8c31d6248d2c/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_) 2023-10-29 16:54:10,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__1a1gg4jmrnfuasbuk6q8bck0buioa9ren94jilkc0j0rle5e2h0lv3l3vcqbkevv/family1/a9860fbd61dd44e5a024dba9a5961925 2023-10-29 16:54:10,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:54:10,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:54:10,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): ff824f34119091986d5f8c31d6248d2c/family1 is initiating minor compaction 2023-10-29 16:54:10,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@86c30db; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:10,259 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff824f34119091986d5f8c31d6248d2c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:10,260 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp, totalSize=50.3 K 2023-10-29 16:54:10,260 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5c6cfffc714644f99e2a4167d6174e67, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:54:10,260 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 84dfed54e7094277bc2a7f4e576b6cdb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:54:10,260 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 101310895ef34efe9ffa7deb7fde0870, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:54:10,260 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 521e11cd41cf40028ceadd32300752e4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:54:10,260 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 34d9297664c748528645e383bf5ec67a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:54:10,261 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting fb760b6755f043e49edbae020ac0e4ea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:54:10,261 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting e1c5a62b82df4b2e9494112e6ee2688b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:54:10,261 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 318aa494dbcb4fbfac4eeb547697e169, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:54:10,261 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 338acdba84104018b42fd2824bc75afa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:54:10,261 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:54:10,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:10,263 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:10,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bf01c4ddd24c4632bcf5b15f104b6732 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228bf01c4ddd24c4632bcf5b15f104b6732 2023-10-29 16:54:10,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd1d147329f4469f84f0e4192be4b01d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231bd1d147329f4469f84f0e4192be4b01d 2023-10-29 16:54:10,267 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4262f591072496ba4eef7ae252cbc3b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101c4262f591072496ba4eef7ae252cbc3b 2023-10-29 16:54:10,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010367fd146acc0947a1a6d6be51339d3f59 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010367fd146acc0947a1a6d6be51339d3f59 2023-10-29 16:54:10,268 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-29 16:54:10,268 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,269 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,300 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff824f34119091986d5f8c31d6248d2c#family1#compaction#72 average throughput is 0.79 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:10,734 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/1f1de5b18116478195063dc0afb47de7 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1f1de5b18116478195063dc0afb47de7 2023-10-29 16:54:10,736 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205aab5d6f985df4505afc6026b6b37c160 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205aab5d6f985df4505afc6026b6b37c160 2023-10-29 16:54:10,737 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:10,741 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ff824f34119091986d5f8c31d6248d2c/family1 of ff824f34119091986d5f8c31d6248d2c into 1f1de5b18116478195063dc0afb47de7(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:10,741 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:10,742 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698598450259; duration=0sec 2023-10-29 16:54:10,742 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:10,763 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/80b7107707a94b2d810967a9107a77bf first=Optional[r00] last=Optional[r2] 2023-10-29 16:54:10,764 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/80b7107707a94b2d810967a9107a77bf}] 2023-10-29 16:54:10,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/80b7107707a94b2d810967a9107a77bf for inclusion in ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:10,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 16:54:10,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:54:10,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:10,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/80b7107707a94b2d810967a9107a77bf to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u5uqdavn3hm6kr83f1f0umv4t6crebm60iud2qenakq71ofa9bt5g9i84353n5sa/family1/80b7107707a94b2d810967a9107a77bf 2023-10-29 16:54:10,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u5uqdavn3hm6kr83f1f0umv4t6crebm60iud2qenakq71ofa9bt5g9i84353n5sa/family1/80b7107707a94b2d810967a9107a77bf as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_ 2023-10-29 16:54:10,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u5uqdavn3hm6kr83f1f0umv4t6crebm60iud2qenakq71ofa9bt5g9i84353n5sa/family1/80b7107707a94b2d810967a9107a77bf into ff824f34119091986d5f8c31d6248d2c/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_ - updating store file list. 2023-10-29 16:54:10,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_ into ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:10,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u5uqdavn3hm6kr83f1f0umv4t6crebm60iud2qenakq71ofa9bt5g9i84353n5sa/family1/80b7107707a94b2d810967a9107a77bf into ff824f34119091986d5f8c31d6248d2c/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_) 2023-10-29 16:54:10,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__u5uqdavn3hm6kr83f1f0umv4t6crebm60iud2qenakq71ofa9bt5g9i84353n5sa/family1/80b7107707a94b2d810967a9107a77bf 2023-10-29 16:54:10,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 16:54:10,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 16:54:10,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): ff824f34119091986d5f8c31d6248d2c/family1 is initiating minor compaction (all files) 2023-10-29 16:54:10,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30471f9e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:10,778 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2259): Starting compaction of ff824f34119091986d5f8c31d6248d2c/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:10,778 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1f1de5b18116478195063dc0afb47de7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp, totalSize=388.1 K 2023-10-29 16:54:10,778 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting 7999f97c26294e54b8efb85b2381e5b7, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:54:10,779 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting 1f1de5b18116478195063dc0afb47de7, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:54:10,779 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting 49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850293 2023-10-29 16:54:10,779 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:10,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:10,781 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308442e9c8caba40c584f58486655085b5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511308442e9c8caba40c584f58486655085b5 2023-10-29 16:54:10,782 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d106a4f4d0fc419ebe3bc9783c21cb5a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201d106a4f4d0fc419ebe3bc9783c21cb5a 2023-10-29 16:54:10,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec925bdb19e94b0ea5f621ad695c5169 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205ec925bdb19e94b0ea5f621ad695c5169 2023-10-29 16:54:10,783 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-29 16:54:10,783 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 16:54:10,784 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:10,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:10,784 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:10,785 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:10,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4490 sec 2023-10-29 16:54:10,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_] to archive 2023-10-29 16:54:10,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:10,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/5c6cfffc714644f99e2a4167d6174e67 2023-10-29 16:54:10,802 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] throttle.PressureAwareThroughputController(145): ff824f34119091986d5f8c31d6248d2c#family1#compaction#73 average throughput is 11.98 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:10,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/84dfed54e7094277bc2a7f4e576b6cdb 2023-10-29 16:54:10,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/101310895ef34efe9ffa7deb7fde0870 2023-10-29 16:54:10,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/521e11cd41cf40028ceadd32300752e4 2023-10-29 16:54:10,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/34d9297664c748528645e383bf5ec67a 2023-10-29 16:54:10,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/fb760b6755f043e49edbae020ac0e4ea 2023-10-29 16:54:10,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/e1c5a62b82df4b2e9494112e6ee2688b 2023-10-29 16:54:10,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/318aa494dbcb4fbfac4eeb547697e169 2023-10-29 16:54:10,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/338acdba84104018b42fd2824bc75afa 2023-10-29 16:54:10,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1815e7e324ee4f1399b1e1c3db26598b_SeqId_44_ 2023-10-29 16:54:10,830 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-10-29 16:54:10,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 16:54:10,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:11,288 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 16:54:11,291 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 16:54:11,291 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 16:54:11,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 16:54:11,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE}] 2023-10-29 16:54:11,297 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE 2023-10-29 16:54:11,298 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:11,298 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598451298"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598451298"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598451298"}]},"ts":"1698598451298"} 2023-10-29 16:54:11,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:11,451 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:11,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ff824f34119091986d5f8c31d6248d2c, disabling compactions & flushes 2023-10-29 16:54:11,452 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,639 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/.tmp/family1/f988e230e4b2436f85cf28302c26b7c8 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/f988e230e4b2436f85cf28302c26b7c8 2023-10-29 16:54:11,647 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ff824f34119091986d5f8c31d6248d2c/family1 of ff824f34119091986d5f8c31d6248d2c into f988e230e4b2436f85cf28302c26b7c8(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:11,647 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:11,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,647 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1698598450777; duration=0sec 2023-10-29 16:54:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. after waiting 0 ms 2023-10-29 16:54:11,647 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:11,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,650 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1f1de5b18116478195063dc0afb47de7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_] to archive 2023-10-29 16:54:11,651 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:11,653 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/7999f97c26294e54b8efb85b2381e5b7 2023-10-29 16:54:11,655 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1f1de5b18116478195063dc0afb47de7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/1f1de5b18116478195063dc0afb47de7 2023-10-29 16:54:11,657 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/49f8f3c24f7641a8aaf0caa451dac5a2_SeqId_47_ 2023-10-29 16:54:11,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 16:54:11,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:11,665 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ff824f34119091986d5f8c31d6248d2c to self. 2023-10-29 16:54:11,667 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,668 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=CLOSED 2023-10-29 16:54:11,668 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598451668"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598451668"}]},"ts":"1698598451668"} 2023-10-29 16:54:11,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-29 16:54:11,671 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 370 msec 2023-10-29 16:54:11,672 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=true 2023-10-29 16:54:11,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:11,823 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598451822"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598451822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598451822"}]},"ts":"1698598451822"} 2023-10-29 16:54:11,825 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:11,977 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:11,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:11,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff824f34119091986d5f8c31d6248d2c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:54:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,987 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,989 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:11,989 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:11,989 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff824f34119091986d5f8c31d6248d2c columnFamilyName family1 2023-10-29 16:54:11,995 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/f988e230e4b2436f85cf28302c26b7c8 2023-10-29 16:54:11,995 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(310): Store=ff824f34119091986d5f8c31d6248d2c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:11,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:11,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:12,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:12,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ff824f34119091986d5f8c31d6248d2c; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74749635, jitterRate=0.11385636031627655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:54:12,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:12,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., pid=63, masterSystemTime=1698598451977 2023-10-29 16:54:12,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:12,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:12,003 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:12,003 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598452003"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598452003"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598452003"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598452003"}]},"ts":"1698598452003"} 2023-10-29 16:54:12,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-29 16:54:12,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 180 msec 2023-10-29 16:54:12,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-29 16:54:12,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE in 710 msec 2023-10-29 16:54:12,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-29 16:54:12,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 714 msec 2023-10-29 16:54:12,010 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1330 sec 2023-10-29 16:54:12,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-29 16:54:12,012 INFO [Listener at localhost/45209] compactions.TestMobCompactor(278): alter status finished 2023-10-29 16:54:12,012 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:12,014 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:12,014 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:12,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:12,015 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599052015 2023-10-29 16:54:12,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:54:12,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 16:54:12,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:12,017 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x226dbb9d to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:12,021 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd824b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:12,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,022 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,849 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128121a984702c043aaa1427434fb811f9f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128121a984702c043aaa1427434fb811f9f 2023-10-29 16:54:12,850 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:12,868 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:12,869 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:12,875 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:54:12,877 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:54:12,885 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c32e4509fded47a2bc3b6a2634c35a53 first=Optional[r05] last=Optional[r8] 2023-10-29 16:54:12,886 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=51 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c32e4509fded47a2bc3b6a2634c35a53}] 2023-10-29 16:54:12,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c32e4509fded47a2bc3b6a2634c35a53 for inclusion in ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:12,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 16:54:12,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:54:12,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:12,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/c32e4509fded47a2bc3b6a2634c35a53 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__il655fb6vule8ko1er9lklh7jfap4sb2rl7kns1v19la5lbc9t4svsuea9cimeg6/family1/c32e4509fded47a2bc3b6a2634c35a53 2023-10-29 16:54:12,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__il655fb6vule8ko1er9lklh7jfap4sb2rl7kns1v19la5lbc9t4svsuea9cimeg6/family1/c32e4509fded47a2bc3b6a2634c35a53 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/8590fd182956438780bdd24fc6af4981_SeqId_53_ 2023-10-29 16:54:12,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__il655fb6vule8ko1er9lklh7jfap4sb2rl7kns1v19la5lbc9t4svsuea9cimeg6/family1/c32e4509fded47a2bc3b6a2634c35a53 into ff824f34119091986d5f8c31d6248d2c/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/8590fd182956438780bdd24fc6af4981_SeqId_53_ - updating store file list. 2023-10-29 16:54:12,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/8590fd182956438780bdd24fc6af4981_SeqId_53_ into ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:12,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__il655fb6vule8ko1er9lklh7jfap4sb2rl7kns1v19la5lbc9t4svsuea9cimeg6/family1/c32e4509fded47a2bc3b6a2634c35a53 into ff824f34119091986d5f8c31d6248d2c/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/8590fd182956438780bdd24fc6af4981_SeqId_53_) 2023-10-29 16:54:12,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__il655fb6vule8ko1er9lklh7jfap4sb2rl7kns1v19la5lbc9t4svsuea9cimeg6/family1/c32e4509fded47a2bc3b6a2634c35a53 2023-10-29 16:54:12,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:12,907 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:12,910 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120104a2f58d2e444caad402f830e325696 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120104a2f58d2e444caad402f830e325696 2023-10-29 16:54:12,911 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284352bbd3211749d68b393758b38911a1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511284352bbd3211749d68b393758b38911a1 2023-10-29 16:54:12,911 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-29 16:54:12,911 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 16:54:12,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,912 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:12,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:12,912 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:12,913 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:12,914 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 900 msec 2023-10-29 16:54:12,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-29 16:54:12,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:13,390 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 16:54:13,393 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 16:54:13,393 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 16:54:13,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 16:54:13,401 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE}] 2023-10-29 16:54:13,403 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE 2023-10-29 16:54:13,404 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:13,405 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598453404"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598453404"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598453404"}]},"ts":"1698598453404"} 2023-10-29 16:54:13,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:13,559 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:13,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ff824f34119091986d5f8c31d6248d2c, disabling compactions & flushes 2023-10-29 16:54:13,561 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. after waiting 0 ms 2023-10-29 16:54:13,561 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 16:54:13,575 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,575 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:13,575 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: ff824f34119091986d5f8c31d6248d2c to self. 2023-10-29 16:54:13,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,577 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=CLOSED 2023-10-29 16:54:13,577 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598453577"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598453577"}]},"ts":"1698598453577"} 2023-10-29 16:54:13,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-29 16:54:13,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 171 msec 2023-10-29 16:54:13,580 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=true 2023-10-29 16:54:13,730 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:13,731 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598453730"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598453730"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598453730"}]},"ts":"1698598453730"} 2023-10-29 16:54:13,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:13,888 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:13,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff824f34119091986d5f8c31d6248d2c, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:54:13,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:13,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,899 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,901 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:13,901 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1 2023-10-29 16:54:13,902 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff824f34119091986d5f8c31d6248d2c columnFamilyName family1 2023-10-29 16:54:13,906 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/8590fd182956438780bdd24fc6af4981_SeqId_53_ 2023-10-29 16:54:13,909 DEBUG [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/family1/f988e230e4b2436f85cf28302c26b7c8 2023-10-29 16:54:13,909 INFO [StoreOpener-ff824f34119091986d5f8c31d6248d2c-1] regionserver.HStore(310): Store=ff824f34119091986d5f8c31d6248d2c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:13,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:54:13,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ff824f34119091986d5f8c31d6248d2c; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62866951, jitterRate=-0.0632094293832779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:54:13,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:54:13,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c., pid=69, masterSystemTime=1698598453888 2023-10-29 16:54:13,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:54:13,916 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=ff824f34119091986d5f8c31d6248d2c, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:13,916 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698598453915"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598453915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598453915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598453915"}]},"ts":"1698598453915"} 2023-10-29 16:54:13,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-29 16:54:13,918 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure ff824f34119091986d5f8c31d6248d2c, server=jenkins-hbase20.apache.org,43165,1698598366173 in 183 msec 2023-10-29 16:54:13,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-29 16:54:13,919 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=ff824f34119091986d5f8c31d6248d2c, REOPEN/MOVE in 517 msec 2023-10-29 16:54:13,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-29 16:54:13,920 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 522 msec 2023-10-29 16:54:13,921 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 944 msec 2023-10-29 16:54:13,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-29 16:54:13,923 INFO [Listener at localhost/45209] compactions.TestMobCompactor(278): alter status finished 2023-10-29 16:54:13,923 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 16:54:13,924 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:13,925 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:13,925 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599053925 2023-10-29 16:54:13,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:13,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:54:13,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 16:54:13,927 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:13,929 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x209cc256 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:13,933 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a0a403b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:13,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,933 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,934 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 16:54:13,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 16:54:13,934 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:13,935 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 16:54:13,936 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 11 msec 2023-10-29 16:54:13,980 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=244 (was 246), OpenFileDescriptor=628 (was 619) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 179), ProcessCount=168 (was 170), AvailableMemoryMB=2780 (was 2878) 2023-10-29 16:54:13,992 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=168, AvailableMemoryMB=2780 2023-10-29 16:54:13,994 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 16:54:13,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:13,996 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:54:13,996 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-29 16:54:13,997 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:54:13,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:13,998 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:13,998 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 empty. 2023-10-29 16:54:13,999 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:13,999 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 16:54:14,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:14,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:14,409 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 16:54:14,413 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 68e3bf93ac3f81a26470ee1bfc89b756, NAME => 'testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:14,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:14,824 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:14,825 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 68e3bf93ac3f81a26470ee1bfc89b756, disabling compactions & flushes 2023-10-29 16:54:14,825 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:14,825 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:14,825 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. after waiting 0 ms 2023-10-29 16:54:14,825 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:14,825 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:14,826 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:14,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:54:14,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698598454834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598454834"}]},"ts":"1698598454834"} 2023-10-29 16:54:14,836 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:54:14,837 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:54:14,837 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598454837"}]},"ts":"1698598454837"} 2023-10-29 16:54:14,839 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-29 16:54:14,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, ASSIGN}] 2023-10-29 16:54:14,844 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, ASSIGN 2023-10-29 16:54:14,845 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:14,996 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=68e3bf93ac3f81a26470ee1bfc89b756, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:14,997 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698598454996"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598454996"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598454996"}]},"ts":"1698598454996"} 2023-10-29 16:54:15,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 68e3bf93ac3f81a26470ee1bfc89b756, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:15,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:15,153 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:15,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:15,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 68e3bf93ac3f81a26470ee1bfc89b756, NAME => 'testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:54:15,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-29 16:54:15,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-29 16:54:15,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:15,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,168 INFO [StoreOpener-68e3bf93ac3f81a26470ee1bfc89b756-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,169 DEBUG [StoreOpener-68e3bf93ac3f81a26470ee1bfc89b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1 2023-10-29 16:54:15,169 DEBUG [StoreOpener-68e3bf93ac3f81a26470ee1bfc89b756-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1 2023-10-29 16:54:15,169 INFO [StoreOpener-68e3bf93ac3f81a26470ee1bfc89b756-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 68e3bf93ac3f81a26470ee1bfc89b756 columnFamilyName f1 2023-10-29 16:54:15,170 INFO [StoreOpener-68e3bf93ac3f81a26470ee1bfc89b756-1] regionserver.HStore(310): Store=68e3bf93ac3f81a26470ee1bfc89b756/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:15,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:15,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:15,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 68e3bf93ac3f81a26470ee1bfc89b756; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69375947, jitterRate=0.033782169222831726}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:54:15,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:15,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756., pid=73, masterSystemTime=1698598455153 2023-10-29 16:54:15,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:15,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:15,178 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=68e3bf93ac3f81a26470ee1bfc89b756, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:15,178 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698598455178"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598455178"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598455178"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598455178"}]},"ts":"1698598455178"} 2023-10-29 16:54:15,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-29 16:54:15,181 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 68e3bf93ac3f81a26470ee1bfc89b756, server=jenkins-hbase20.apache.org,43165,1698598366173 in 179 msec 2023-10-29 16:54:15,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-29 16:54:15,182 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, ASSIGN in 339 msec 2023-10-29 16:54:15,182 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:54:15,182 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598455182"}]},"ts":"1698598455182"} 2023-10-29 16:54:15,183 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-29 16:54:15,186 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:54:15,187 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1920 sec 2023-10-29 16:54:15,319 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 16:54:15,319 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-10-29 16:54:16,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 16:54:16,108 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-29 16:54:16,108 DEBUG [Listener at localhost/45209] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-29 16:54:16,112 INFO [Listener at localhost/45209] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 16:54:16,118 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-29 16:54:16,119 INFO [Listener at localhost/45209] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 16:54:16,119 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-29 16:54:16,122 INFO [Listener at localhost/45209] regionserver.HRegion(2745): Flushing 68e3bf93ac3f81a26470ee1bfc89b756 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 16:54:16,543 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102921dc979d135c48d8920e775d7996dc6a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102921dc979d135c48d8920e775d7996dc6a 2023-10-29 16:54:16,951 INFO [Listener at localhost/45209] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp/f1/863ff42a43f14ed6be74841f5a19e879 2023-10-29 16:54:16,961 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp/f1/863ff42a43f14ed6be74841f5a19e879 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879 2023-10-29 16:54:16,966 INFO [Listener at localhost/45209] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 16:54:16,967 INFO [Listener at localhost/45209] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 68e3bf93ac3f81a26470ee1bfc89b756 in 845ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:16,967 DEBUG [Listener at localhost/45209] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-29 16:54:16,968 DEBUG [Listener at localhost/45209] regionserver.HRegion(2446): Flush status journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:16,970 INFO [Listener at localhost/45209] regionserver.HRegion(2745): Flushing 68e3bf93ac3f81a26470ee1bfc89b756 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 16:54:17,202 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:17,387 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296a16eae3d938475e91ef2568b9b8ad55 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310296a16eae3d938475e91ef2568b9b8ad55 2023-10-29 16:54:17,798 INFO [Listener at localhost/45209] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp/f1/e167ed22229c4f0ba61099ea807bfd13 2023-10-29 16:54:17,810 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp/f1/e167ed22229c4f0ba61099ea807bfd13 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13 2023-10-29 16:54:17,815 INFO [Listener at localhost/45209] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13, entries=1, sequenceid=9, filesize=4.9 K 2023-10-29 16:54:17,816 INFO [Listener at localhost/45209] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 68e3bf93ac3f81a26470ee1bfc89b756 in 846ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:17,816 DEBUG [Listener at localhost/45209] regionserver.HRegion(2446): Flush status journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:17,818 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-29 16:54:17,820 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 16:54:17,821 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 16:54:17,822 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599057822 2023-10-29 16:54:17,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:17,822 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:54:17,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-29 16:54:17,823 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-29 16:54:17,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x7bf367bb to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:17,828 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@300fb66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:17,829 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 16:54:17,870 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:17,870 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:17,921 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:17,922 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:17,973 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:17,973 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,025 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,025 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,076 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,076 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,127 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,127 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,178 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,178 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,230 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,230 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,264 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298c59f78ff2464e208c6baf10a99add84 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310298c59f78ff2464e208c6baf10a99add84 2023-10-29 16:54:18,265 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 16:54:18,278 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:18,279 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:18,281 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,281 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,284 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:54:18,286 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:54:18,295 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/7df97b6e39594f1883669101dd74b1af first=Optional[r1] last=Optional[r2] 2023-10-29 16:54:18,296 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{f1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/7df97b6e39594f1883669101dd74b1af}] 2023-10-29 16:54:18,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/7df97b6e39594f1883669101dd74b1af for inclusion in 68e3bf93ac3f81a26470ee1bfc89b756/f1 2023-10-29 16:54:18,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 16:54:18,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:54:18,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:18,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/7df97b6e39594f1883669101dd74b1af to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testGetAfterCompaction__bsg90b0halhut1ml3bfirkhpvg1bcsciu7ipgkgu7obu72kb7v311shjl9hvl1pu/f1/7df97b6e39594f1883669101dd74b1af 2023-10-29 16:54:18,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testGetAfterCompaction__bsg90b0halhut1ml3bfirkhpvg1bcsciu7ipgkgu7obu72kb7v311shjl9hvl1pu/f1/7df97b6e39594f1883669101dd74b1af as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_ 2023-10-29 16:54:18,310 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testGetAfterCompaction__bsg90b0halhut1ml3bfirkhpvg1bcsciu7ipgkgu7obu72kb7v311shjl9hvl1pu/f1/7df97b6e39594f1883669101dd74b1af into 68e3bf93ac3f81a26470ee1bfc89b756/f1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_ - updating store file list. 2023-10-29 16:54:18,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_ into 68e3bf93ac3f81a26470ee1bfc89b756/f1 2023-10-29 16:54:18,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testGetAfterCompaction__bsg90b0halhut1ml3bfirkhpvg1bcsciu7ipgkgu7obu72kb7v311shjl9hvl1pu/f1/7df97b6e39594f1883669101dd74b1af into 68e3bf93ac3f81a26470ee1bfc89b756/f1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_) 2023-10-29 16:54:18,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testGetAfterCompaction__bsg90b0halhut1ml3bfirkhpvg1bcsciu7ipgkgu7obu72kb7v311shjl9hvl1pu/f1/7df97b6e39594f1883669101dd74b1af 2023-10-29 16:54:18,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(1912): 68e3bf93ac3f81a26470ee1bfc89b756/f1 is initiating minor compaction 2023-10-29 16:54:18,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d6b16c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:18,314 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 68e3bf93ac3f81a26470ee1bfc89b756/f1 in testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:18,314 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp, totalSize=10.0 K 2023-10-29 16:54:18,314 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting e167ed22229c4f0ba61099ea807bfd13, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:54:18,314 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting c0acf004d52a426bb3a5f16014142a64_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:54:18,316 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 16:54:18,317 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:18,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102921dc979d135c48d8920e775d7996dc6a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023102921dc979d135c48d8920e775d7996dc6a 2023-10-29 16:54:18,320 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310296a16eae3d938475e91ef2568b9b8ad55 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310296a16eae3d938475e91ef2568b9b8ad55 2023-10-29 16:54:18,320 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-29 16:54:18,320 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 16:54:18,321 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 16:54:18,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-29 16:54:18,321 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:54:18,322 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 16:54:18,323 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 503 msec 2023-10-29 16:54:18,328 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] throttle.PressureAwareThroughputController(145): 68e3bf93ac3f81a26470ee1bfc89b756#f1#compaction#76 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:18,332 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,332 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,332 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,335 DEBUG [Listener at localhost/45209] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 16:54:18,338 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 16:54:18,339 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43165] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:18,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-29 16:54:18,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 16:54:18,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43165] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 16:54:18,339 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43165] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. because compaction request was cancelled 2023-10-29 16:54:18,391 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,391 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,391 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,442 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,442 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,442 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,493 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,494 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,494 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,545 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,545 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,545 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,597 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,597 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,597 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,649 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,649 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,649 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,701 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,701 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,701 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,752 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,753 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,753 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,805 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,805 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,805 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,857 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,857 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,857 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,909 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,909 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,909 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,961 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:18,962 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:18,962 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,014 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,014 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:19,014 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,066 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,066 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:19,067 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,118 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,119 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:19,119 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,159 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/.tmp/f1/eba0f4a574794b7db6911a5263ef7ddf as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/eba0f4a574794b7db6911a5263ef7ddf 2023-10-29 16:54:19,165 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 68e3bf93ac3f81a26470ee1bfc89b756/f1 of 68e3bf93ac3f81a26470ee1bfc89b756 into eba0f4a574794b7db6911a5263ef7ddf(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:19,165 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:19,166 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698598458314; duration=0sec 2023-10-29 16:54:19,166 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:19,170 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,170 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698598458257; access_time=1698598457841; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 16:54:19,170 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598457797; access_time=1698598456972; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,170 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/eba0f4a574794b7db6911a5263ef7ddf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698598459145; access_time=1698598458320; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_] to archive 2023-10-29 16:54:19,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:19,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/e167ed22229c4f0ba61099ea807bfd13 2023-10-29 16:54:19,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/c0acf004d52a426bb3a5f16014142a64_SeqId_12_ 2023-10-29 16:54:19,221 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698598456950; access_time=1698598456125; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,221 INFO [Listener at localhost/45209] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/eba0f4a574794b7db6911a5263ef7ddf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698598459145; access_time=1698598458320; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 16:54:19,351 INFO [Listener at localhost/45209] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-29 16:54:19,355 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-10-29 16:54:19,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,365 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598459365"}]},"ts":"1698598459365"} 2023-10-29 16:54:19,367 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-29 16:54:19,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 16:54:19,368 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-29 16:54:19,369 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, UNASSIGN}] 2023-10-29 16:54:19,371 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, UNASSIGN 2023-10-29 16:54:19,372 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=68e3bf93ac3f81a26470ee1bfc89b756, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:19,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698598459371"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598459371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598459371"}]},"ts":"1698598459371"} 2023-10-29 16:54:19,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 68e3bf93ac3f81a26470ee1bfc89b756, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:19,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 16:54:19,525 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:19,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:19,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 68e3bf93ac3f81a26470ee1bfc89b756, disabling compactions & flushes 2023-10-29 16:54:19,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:19,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:19,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. after waiting 0 ms 2023-10-29 16:54:19,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:19,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 16:54:19,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 16:54:19,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756. 2023-10-29 16:54:19,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 68e3bf93ac3f81a26470ee1bfc89b756: 2023-10-29 16:54:19,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:19,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=68e3bf93ac3f81a26470ee1bfc89b756, regionState=CLOSED 2023-10-29 16:54:19,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698598459532"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598459532"}]},"ts":"1698598459532"} 2023-10-29 16:54:19,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-29 16:54:19,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 68e3bf93ac3f81a26470ee1bfc89b756, server=jenkins-hbase20.apache.org,43165,1698598366173 in 161 msec 2023-10-29 16:54:19,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-29 16:54:19,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=68e3bf93ac3f81a26470ee1bfc89b756, UNASSIGN in 166 msec 2023-10-29 16:54:19,537 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598459537"}]},"ts":"1698598459537"} 2023-10-29 16:54:19,538 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-29 16:54:19,539 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-29 16:54:19,540 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 183 msec 2023-10-29 16:54:19,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 16:54:19,670 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-29 16:54:19,674 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-10-29 16:54:19,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,682 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,683 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 16:54:19,686 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:19,688 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1, FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/recovered.edits] 2023-10-29 16:54:19,692 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/863ff42a43f14ed6be74841f5a19e879 2023-10-29 16:54:19,693 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/eba0f4a574794b7db6911a5263ef7ddf to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/f1/eba0f4a574794b7db6911a5263ef7ddf 2023-10-29 16:54:19,695 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/recovered.edits/15.seqid to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756/recovered.edits/15.seqid 2023-10-29 16:54:19,696 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testGetAfterCompaction/68e3bf93ac3f81a26470ee1bfc89b756 2023-10-29 16:54:19,696 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 16:54:19,696 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 16:54:19,697 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-29 16:54:19,700 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310298c59f78ff2464e208c6baf10a99add84 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310298c59f78ff2464e208c6baf10a99add84 2023-10-29 16:54:19,701 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 16:54:19,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,724 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-29 16:54:19,726 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-29 16:54:19,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,727 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-29 16:54:19,728 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698598459728"}]},"ts":"9223372036854775807"} 2023-10-29 16:54:19,729 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-29 16:54:19,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 68e3bf93ac3f81a26470ee1bfc89b756, NAME => 'testGetAfterCompaction,,1698598453994.68e3bf93ac3f81a26470ee1bfc89b756.', STARTKEY => '', ENDKEY => ''}] 2023-10-29 16:54:19,730 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-29 16:54:19,730 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698598459730"}]},"ts":"9223372036854775807"} 2023-10-29 16:54:19,732 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-29 16:54:19,733 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 16:54:19,734 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 57 msec 2023-10-29 16:54:19,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 16:54:19,786 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-29 16:54:19,797 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=247 (was 244) - Thread LEAK? -, OpenFileDescriptor=628 (was 628), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 176), ProcessCount=168 (was 168), AvailableMemoryMB=2760 (was 2780) 2023-10-29 16:54:19,807 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=247, OpenFileDescriptor=628, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=168, AvailableMemoryMB=2760 2023-10-29 16:54:19,809 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 16:54:19,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-29 16:54:19,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:54:19,812 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-29 16:54:19,812 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:54:19,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:19,815 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:19,815 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:19,815 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 empty. 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 empty. 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 empty. 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:19,816 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:19,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-29 16:54:19,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:20,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:20,230 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 16:54:20,233 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5654fa8c3658e7e7b12d603407068476, NAME => 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:20,234 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 2de4f508daf224aaf110e9ea7a56b9d5, NAME => 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:20,235 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 85653a47b2e3f679e9493cdd405920d6, NAME => 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:20,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:20,646 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 2de4f508daf224aaf110e9ea7a56b9d5, disabling compactions & flushes 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:20,647 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. after waiting 0 ms 2023-10-29 16:54:20,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 5654fa8c3658e7e7b12d603407068476, disabling compactions & flushes 2023-10-29 16:54:20,648 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:20,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:20,647 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 85653a47b2e3f679e9493cdd405920d6, disabling compactions & flushes 2023-10-29 16:54:20,648 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,648 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. after waiting 0 ms 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:20,648 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. after waiting 0 ms 2023-10-29 16:54:20,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:20,649 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,649 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:20,652 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:54:20,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598460653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598460653"}]},"ts":"1698598460653"} 2023-10-29 16:54:20,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598460653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598460653"}]},"ts":"1698598460653"} 2023-10-29 16:54:20,653 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598460653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598460653"}]},"ts":"1698598460653"} 2023-10-29 16:54:20,655 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 16:54:20,656 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:54:20,656 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598460656"}]},"ts":"1698598460656"} 2023-10-29 16:54:20,656 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 16:54:20,659 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN}] 2023-10-29 16:54:20,661 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN 2023-10-29 16:54:20,661 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN 2023-10-29 16:54:20,661 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN 2023-10-29 16:54:20,661 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:20,661 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:20,661 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:20,813 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:20,813 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:20,813 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598460813"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598460813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598460813"}]},"ts":"1698598460813"} 2023-10-29 16:54:20,813 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:20,813 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598460813"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598460813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598460813"}]},"ts":"1698598460813"} 2023-10-29 16:54:20,814 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598460813"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598460813"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598460813"}]},"ts":"1698598460813"} 2023-10-29 16:54:20,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:20,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:20,818 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:20,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:20,968 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:20,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85653a47b2e3f679e9493cdd405920d6, NAME => 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 16:54:20,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:20,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,976 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,978 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:20,978 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:20,979 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85653a47b2e3f679e9493cdd405920d6 columnFamilyName family1 2023-10-29 16:54:20,980 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(310): Store=85653a47b2e3f679e9493cdd405920d6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:20,980 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,981 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2 2023-10-29 16:54:20,982 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2 2023-10-29 16:54:20,982 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85653a47b2e3f679e9493cdd405920d6 columnFamilyName family2 2023-10-29 16:54:20,983 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(310): Store=85653a47b2e3f679e9493cdd405920d6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:20,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:20,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:20,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 85653a47b2e3f679e9493cdd405920d6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67567719, jitterRate=0.006837472319602966}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:20,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:20,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., pid=84, masterSystemTime=1698598460968 2023-10-29 16:54:20,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:20,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2de4f508daf224aaf110e9ea7a56b9d5, NAME => 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 16:54:20,991 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,991 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598460991"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598460991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598460991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598460991"}]},"ts":"1698598460991"} 2023-10-29 16:54:20,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,992 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,994 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:20,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-10-29 16:54:20,994 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:20,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173 in 176 msec 2023-10-29 16:54:20,994 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4f508daf224aaf110e9ea7a56b9d5 columnFamilyName family1 2023-10-29 16:54:20,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN in 336 msec 2023-10-29 16:54:20,995 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(310): Store=2de4f508daf224aaf110e9ea7a56b9d5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:20,996 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,996 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2 2023-10-29 16:54:20,997 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2 2023-10-29 16:54:20,997 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4f508daf224aaf110e9ea7a56b9d5 columnFamilyName family2 2023-10-29 16:54:20,997 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(310): Store=2de4f508daf224aaf110e9ea7a56b9d5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:20,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:20,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:21,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:21,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:21,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:21,003 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2de4f508daf224aaf110e9ea7a56b9d5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59952747, jitterRate=-0.10663445293903351}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:21,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:21,004 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., pid=85, masterSystemTime=1698598460968 2023-10-29 16:54:21,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:21,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:21,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:21,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5654fa8c3658e7e7b12d603407068476, NAME => 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 16:54:21,005 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:21,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,005 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598461005"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598461005"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598461005"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598461005"}]},"ts":"1698598461005"} 2023-10-29 16:54:21,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:21,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,007 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,008 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:21,008 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:21,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-10-29 16:54:21,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173 in 191 msec 2023-10-29 16:54:21,008 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5654fa8c3658e7e7b12d603407068476 columnFamilyName family1 2023-10-29 16:54:21,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN in 349 msec 2023-10-29 16:54:21,009 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(310): Store=5654fa8c3658e7e7b12d603407068476/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:21,010 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,011 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2 2023-10-29 16:54:21,011 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2 2023-10-29 16:54:21,011 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5654fa8c3658e7e7b12d603407068476 columnFamilyName family2 2023-10-29 16:54:21,012 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(310): Store=5654fa8c3658e7e7b12d603407068476/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:21,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:21,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:21,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:21,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5654fa8c3658e7e7b12d603407068476; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59863752, jitterRate=-0.10796058177947998}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:21,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:21,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., pid=83, masterSystemTime=1698598460968 2023-10-29 16:54:21,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:21,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:21,020 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:21,020 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598461020"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598461020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598461020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598461020"}]},"ts":"1698598461020"} 2023-10-29 16:54:21,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-10-29 16:54:21,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173 in 206 msec 2023-10-29 16:54:21,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-10-29 16:54:21,023 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN in 364 msec 2023-10-29 16:54:21,024 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:54:21,024 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598461024"}]},"ts":"1698598461024"} 2023-10-29 16:54:21,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 16:54:21,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:54:21,028 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2180 sec 2023-10-29 16:54:21,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 16:54:21,922 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-29 16:54:21,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:21,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:21,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:21,932 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:21,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 16:54:21,934 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 16:54:21,934 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:21,934 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 16:54:21,934 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 16:54:21,935 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:21,935 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:21,935 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:21,935 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:21,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:21,936 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:21,936 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:21,936 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 16:54:21,937 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 16:54:21,937 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 16:54:21,937 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:21,937 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 16:54:21,937 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:21,937 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:21,937 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:21,937 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:21,937 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:21,938 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:21,937 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:21,938 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2de4f508daf224aaf110e9ea7a56b9d5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:21,938 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5654fa8c3658e7e7b12d603407068476 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:21,938 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:21,939 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 85653a47b2e3f679e9493cdd405920d6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:22,363 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba 2023-10-29 16:54:22,363 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff 2023-10-29 16:54:22,363 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 2023-10-29 16:54:22,368 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/a12cbd737b11473fa4ec394b7998beb2 2023-10-29 16:54:22,368 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/a1a7b814e3c241a9995049ece894b842 2023-10-29 16:54:22,769 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/b412fdb907c940c1a5aa400eac404852 2023-10-29 16:54:22,786 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5 2023-10-29 16:54:22,786 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc 2023-10-29 16:54:22,793 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd 2023-10-29 16:54:23,193 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/cb008d1d293c41c98f9e05d4fc001ebb 2023-10-29 16:54:23,194 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/b7744e3cdad1417da9a3f01a407f88f8 2023-10-29 16:54:23,198 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/ffebc3cf1a8149b2828d66ef747cd75d 2023-10-29 16:54:23,205 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/a1a7b814e3c241a9995049ece894b842 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842 2023-10-29 16:54:23,205 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/a12cbd737b11473fa4ec394b7998beb2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2 2023-10-29 16:54:23,206 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/b412fdb907c940c1a5aa400eac404852 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852 2023-10-29 16:54:23,210 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:23,211 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:23,211 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/b7744e3cdad1417da9a3f01a407f88f8 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8 2023-10-29 16:54:23,211 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/cb008d1d293c41c98f9e05d4fc001ebb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb 2023-10-29 16:54:23,212 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:23,215 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/ffebc3cf1a8149b2828d66ef747cd75d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d 2023-10-29 16:54:23,218 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:23,218 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:23,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:23,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5654fa8c3658e7e7b12d603407068476 in 1281ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:23,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 85653a47b2e3f679e9493cdd405920d6 in 1280ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:23,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2de4f508daf224aaf110e9ea7a56b9d5 in 1281ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:23,219 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 16:54:23,219 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 16:54:23,219 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 16:54:23,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:23,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:23,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:23,221 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:23,220 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:23,221 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 16:54:23,221 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 16:54:23,222 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,222 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:23,222 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,222 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:23,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 16:54:23,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e38cfd0[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:23,223 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 16:54:23,224 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,224 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 16:54:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 16:54:23,224 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:23,224 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,224 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:23,225 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,225 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:23,225 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:23,225 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:23,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:23,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 16:54:23,227 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 16:54:23,227 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:23,227 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:23,227 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 16:54:23,227 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:23,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:23,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:23,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:23,228 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,229 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:23,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:23,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:23,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 16:54:23,230 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:23,230 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:23,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:23,230 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,231 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,231 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:23,231 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,231 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:23,231 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:23,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:23,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:23,331 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:23,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:23,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:23,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:23,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:23,340 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:23,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:23,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 16:54:23,345 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 16:54:23,345 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:23,345 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 16:54:23,345 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 16:54:23,345 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,346 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:23,346 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:23,346 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:23,347 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:23,347 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:23,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:23,348 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 16:54:23,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 16:54:23,349 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 16:54:23,349 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 16:54:23,349 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:23,349 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:23,349 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:23,349 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5654fa8c3658e7e7b12d603407068476 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:23,349 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2de4f508daf224aaf110e9ea7a56b9d5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:23,349 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:23,349 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:23,350 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 85653a47b2e3f679e9493cdd405920d6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:23,773 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b 2023-10-29 16:54:23,773 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 2023-10-29 16:54:23,773 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 2023-10-29 16:54:24,181 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/09a224582b084557aef9f42f91686c37 2023-10-29 16:54:24,182 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/53d8d8e6c7e740caa1db8a27424bafde 2023-10-29 16:54:24,182 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/066e67aad44a4438867dd3f25bc173c4 2023-10-29 16:54:24,201 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71 2023-10-29 16:54:24,319 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x209cc256 to 127.0.0.1:61373 2023-10-29 16:54:24,319 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:24,319 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:24,319 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5abda93c to 127.0.0.1:61373 2023-10-29 16:54:24,319 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:24,322 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:24,322 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x226dbb9d to 127.0.0.1:61373 2023-10-29 16:54:24,322 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:24,326 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:24,326 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7bf367bb to 127.0.0.1:61373 2023-10-29 16:54:24,326 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:24,609 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe 2023-10-29 16:54:24,609 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53 2023-10-29 16:54:24,616 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/cb5a1d70e99641418e339461be3adad6 2023-10-29 16:54:24,621 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/066e67aad44a4438867dd3f25bc173c4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4 2023-10-29 16:54:24,627 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:24,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/cb5a1d70e99641418e339461be3adad6 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6 2023-10-29 16:54:24,633 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:24,634 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5654fa8c3658e7e7b12d603407068476 in 1285ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:24,634 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:24,634 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:24,634 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:24,730 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/59ee49e46505455e8f04343be7d3d3b4 2023-10-29 16:54:24,737 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/09a224582b084557aef9f42f91686c37 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37 2023-10-29 16:54:24,743 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:24,745 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/59ee49e46505455e8f04343be7d3d3b4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4 2023-10-29 16:54:24,751 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:24,752 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 85653a47b2e3f679e9493cdd405920d6 in 1402ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:24,752 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:24,752 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:24,752 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:25,017 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/9af96b69c9eb41a484e1f814d3683ad6 2023-10-29 16:54:25,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/53d8d8e6c7e740caa1db8a27424bafde as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde 2023-10-29 16:54:25,033 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:25,035 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:25,036 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/9af96b69c9eb41a484e1f814d3683ad6 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6 2023-10-29 16:54:25,044 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:25,045 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2de4f508daf224aaf110e9ea7a56b9d5 in 1696ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:25,045 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:25,045 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:25,045 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:25,045 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:25,045 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,045 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 16:54:25,045 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 16:54:25,046 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,046 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:25,047 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,047 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:25,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 16:54:25,048 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 16:54:25,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d3e2b63[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:25,048 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,049 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 16:54:25,049 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,049 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:25,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 16:54:25,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:25,050 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:25,050 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:25,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 16:54:25,052 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 16:54:25,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:25,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:25,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 16:54:25,052 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:25,053 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,053 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:25,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,053 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:25,053 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,055 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:25,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:25,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:25,056 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:25,056 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 16:54:25,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:25,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 16:54:25,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:25,056 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:25,057 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,057 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:25,057 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:25,157 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:25,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:25,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:25,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:25,161 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:25,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:25,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:25,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 16:54:25,171 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 16:54:25,171 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:25,171 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 16:54:25,171 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 16:54:25,172 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,172 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:25,174 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,174 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:25,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:25,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:25,175 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:25,175 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:25,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:25,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:25,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:25,177 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 16:54:25,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 16:54:25,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 16:54:25,177 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 16:54:25,177 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:25,177 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 16:54:25,178 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:25,178 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:25,178 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:25,178 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:25,178 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5654fa8c3658e7e7b12d603407068476 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:25,178 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:25,179 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:25,178 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:25,179 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 85653a47b2e3f679e9493cdd405920d6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:25,179 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:25,179 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2de4f508daf224aaf110e9ea7a56b9d5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:25,319 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 16:54:25,605 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 2023-10-29 16:54:25,605 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 2023-10-29 16:54:25,609 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 2023-10-29 16:54:26,018 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/22b52671071a4d14ba7e25378b464937 2023-10-29 16:54:26,018 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/b28bcaa8021f455cb939e556e385a156 2023-10-29 16:54:26,019 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/82bf3735c53148c791cc957920d4b53a 2023-10-29 16:54:26,038 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db 2023-10-29 16:54:26,039 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6 2023-10-29 16:54:26,443 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/4de9a64c612f4e8a9cfe094711d749cc 2023-10-29 16:54:26,444 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/5d59d55e0be948b0b3944502a368009b 2023-10-29 16:54:26,444 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6 2023-10-29 16:54:26,451 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/b28bcaa8021f455cb939e556e385a156 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156 2023-10-29 16:54:26,451 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/82bf3735c53148c791cc957920d4b53a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a 2023-10-29 16:54:26,456 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:26,456 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:26,457 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/4de9a64c612f4e8a9cfe094711d749cc as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc 2023-10-29 16:54:26,457 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/5d59d55e0be948b0b3944502a368009b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b 2023-10-29 16:54:26,461 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:26,461 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:26,461 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2de4f508daf224aaf110e9ea7a56b9d5 in 1282ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:26,461 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:26,461 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:26,462 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5654fa8c3658e7e7b12d603407068476 in 1283ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:26,462 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:26,462 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:26,462 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:26,462 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:26,851 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/34456cfe9f964133a63ddf498182ed5c 2023-10-29 16:54:26,857 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/22b52671071a4d14ba7e25378b464937 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937 2023-10-29 16:54:26,863 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:26,864 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/34456cfe9f964133a63ddf498182ed5c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c 2023-10-29 16:54:26,870 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:26,871 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 85653a47b2e3f679e9493cdd405920d6 in 1692ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:26,871 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:26,871 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:26,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:26,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:26,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 16:54:26,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 16:54:26,873 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,873 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:26,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:26,873 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,873 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:26,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 16:54:26,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b492121[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:26,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 16:54:26,875 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,876 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,876 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 16:54:26,876 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 16:54:26,876 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:26,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:26,877 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 16:54:26,877 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,877 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:26,877 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 16:54:26,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:26,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 16:54:26,879 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 16:54:26,879 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:26,879 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:26,879 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 16:54:26,879 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:26,880 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,880 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:26,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,881 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:26,881 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:26,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,883 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:26,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:26,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:26,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 16:54:26,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 16:54:26,885 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:26,885 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:26,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:26,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:26,885 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:26,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:26,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:26,886 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:26,986 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:26,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:26,990 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:26,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:26,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:26,998 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:27,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:27,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 16:54:27,000 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 16:54:27,000 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:27,000 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 16:54:27,000 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 16:54:27,001 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:27,001 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:27,002 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:27,002 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:27,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:27,002 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:27,002 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:27,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:27,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:27,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:27,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 16:54:27,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 16:54:27,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 16:54:27,003 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 16:54:27,003 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:27,003 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:27,003 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:27,003 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:27,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:27,003 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5654fa8c3658e7e7b12d603407068476 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:27,003 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 85653a47b2e3f679e9493cdd405920d6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:27,003 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2de4f508daf224aaf110e9ea7a56b9d5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:27,427 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 2023-10-29 16:54:27,427 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 2023-10-29 16:54:27,427 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 2023-10-29 16:54:27,834 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/880165afa0d74aceab8ae9bfabb2600d 2023-10-29 16:54:27,834 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/09fa196f24054456a0f0c25949b86cc0 2023-10-29 16:54:27,834 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/d25c8b1c39ee481bb8543a1cebe81b54 2023-10-29 16:54:28,263 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8 2023-10-29 16:54:28,263 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65 2023-10-29 16:54:28,265 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8 2023-10-29 16:54:28,670 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/d389242a5c3a49249052c24023d3e7a3 2023-10-29 16:54:28,674 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/fecf64228a09408498d552796bcaf41d 2023-10-29 16:54:28,675 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/76ec7635f3494eaa8de39d051f401d0c 2023-10-29 16:54:28,682 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/09fa196f24054456a0f0c25949b86cc0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0 2023-10-29 16:54:28,684 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/880165afa0d74aceab8ae9bfabb2600d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d 2023-10-29 16:54:28,684 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/d25c8b1c39ee481bb8543a1cebe81b54 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54 2023-10-29 16:54:28,687 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:28,688 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/d389242a5c3a49249052c24023d3e7a3 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3 2023-10-29 16:54:28,688 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:28,688 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:28,689 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/fecf64228a09408498d552796bcaf41d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d 2023-10-29 16:54:28,689 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/76ec7635f3494eaa8de39d051f401d0c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c 2023-10-29 16:54:28,693 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:28,693 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:28,694 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:28,694 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2de4f508daf224aaf110e9ea7a56b9d5 in 1691ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:28,694 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5654fa8c3658e7e7b12d603407068476 in 1691ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:28,694 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 85653a47b2e3f679e9493cdd405920d6 in 1691ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:28,694 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:28,694 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:28,694 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:28,695 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:28,695 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:28,695 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,695 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 16:54:28,695 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 16:54:28,696 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,696 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:28,696 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,696 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:28,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:28,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 16:54:28,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@551eaf08[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:28,697 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 16:54:28,697 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,698 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,698 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 16:54:28,698 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 16:54:28,698 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,698 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:28,698 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:28,699 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,699 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 16:54:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:28,699 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:28,699 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 16:54:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:28,702 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 16:54:28,702 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:28,702 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:28,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 16:54:28,702 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 16:54:28,702 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:28,703 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,703 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:28,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,703 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:28,704 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,705 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:28,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:28,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 16:54:28,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:28,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:28,707 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:28,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:28,707 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:28,708 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:28,708 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:28,808 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:28,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:28,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:28,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698598468823 (current time:1698598468823). 2023-10-29 16:54:28,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 16:54:28,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x4e06dc03 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:28,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed03677, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:28,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:28,836 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:28,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e06dc03 to 127.0.0.1:61373 2023-10-29 16:54:28,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:28,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 16:54:28,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:28,845 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot, current working dir path: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/snaptb-1698598468809 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 16:54:28,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:28,853 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:28,853 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698599068853 2023-10-29 16:54:28,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:28,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698598468809 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 16:54:28,855 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:28,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 16:54:28,856 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-29 16:54:28,857 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 16:54:28,858 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698599068858 2023-10-29 16:54:28,859 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:28,859 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 16:54:28,959 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:28,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:28,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:28,967 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 16:54:29,167 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:29,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:29,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:29,169 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 16:54:29,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698598468809 2023-10-29 16:54:29,269 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698598468809' 2023-10-29 16:54:29,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 16:54:29,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698598468809' starting 'acquire' 2023-10-29 16:54:29,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698598468809', kicking off acquire phase on members. 2023-10-29 16:54:29,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698598468809 2023-10-29 16:54:29,272 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 16:54:29,272 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 16:54:29,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 16:54:29,273 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,273 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:29,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698598468809 2023-10-29 16:54:29,274 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-29 16:54:29,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698598468809 2023-10-29 16:54:29,276 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698598468809 from table testCompactionWithHFileLink type FLUSH 2023-10-29 16:54:29,279 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698598468809 2023-10-29 16:54:29,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698598468809' with timeout 300000ms 2023-10-29 16:54:29,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 16:54:29,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698598468809' starting 'acquire' stage 2023-10-29 16:54:29,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698598468809' locally acquired 2023-10-29 16:54:29,279 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (snaptb-1698598468809) in zk 2023-10-29 16:54:29,285 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,285 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 16:54:29,286 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,286 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698598468809' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:29,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'snaptb-1698598468809' on coordinator 2023-10-29 16:54:29,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6de0bc34[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:29,287 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698598468809' starting 'in-barrier' execution. 2023-10-29 16:54:29,288 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,290 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,290 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698598468809' received 'reached' from coordinator. 2023-10-29 16:54:29,290 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,290 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:29,291 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:29,291 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:29,291 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-29 16:54:29,291 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:29,291 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:29,292 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:29,293 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.' region-info for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,293 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.' region-info for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,293 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.' region-info for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,299 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 16:54:29,299 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 16:54:29,299 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54] hfiles 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0] hfiles 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d] hfiles 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,302 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,305 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3] hfiles 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c] hfiles 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d] hfiles 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,306 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3 for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,316 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. completed. 2023-10-29 16:54:29,316 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:29,316 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-29 16:54:29,469 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:29,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:29,471 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 16:54:29,717 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. completed. 2023-10-29 16:54:29,717 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. completed. 2023-10-29 16:54:29,718 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:29,717 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:29,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-29 16:54:29,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-29 16:54:29,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-29 16:54:29,718 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,719 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698598468809' locally completed 2023-10-29 16:54:29,719 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698598468809' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:29,722 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698598468809' has notified controller of completion 2023-10-29 16:54:29,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:29,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698598468809' completed. 2023-10-29 16:54:29,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:29,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 16:54:29,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:29,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:29,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:29,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698598468809' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:29,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'snaptb-1698598468809', counting down latch. Waiting for 0 more 2023-10-29 16:54:29,730 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698598468809' execution completed 2023-10-29 16:54:29,731 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:29,731 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:29,731 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698598468809 2023-10-29 16:54:29,731 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698598468809including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-29 16:54:29,735 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,735 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 16:54:29,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,736 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 16:54:29,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:29,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 16:54:29,737 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 16:54:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,739 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:29,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698598468809 2023-10-29 16:54:29,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,748 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698598468809 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698598468809 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698598468809/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:29,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698598468809 2023-10-29 16:54:29,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 16:54:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 16:54:29,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-29 16:54:29,749 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:29,750 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698598468809 2023-10-29 16:54:29,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698598468809 2023-10-29 16:54:29,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 16:54:29,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 16:54:29,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-29 16:54:29,750 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698598468809 2023-10-29 16:54:29,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1] mob files 2023-10-29 16:54:29,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 2023-10-29 16:54:29,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 2023-10-29 16:54:29,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 2023-10-29 16:54:29,753 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53] mob files 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd 2023-10-29 16:54:29,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5 2023-10-29 16:54:29,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53 2023-10-29 16:54:29,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698598468809 2023-10-29 16:54:29,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/snaptb-1698598468809 2023-10-29 16:54:29,971 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:29,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:29,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:29,974 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 16:54:30,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/snaptb-1698598468809 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/snaptb-1698598468809 2023-10-29 16:54:30,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698598468809 of table testCompactionWithHFileLink completed 2023-10-29 16:54:30,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/snaptb-1698598468809 2023-10-29 16:54:30,218 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/snaptb-1698598468809 2023-10-29 16:54:30,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698598468809 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698598468854Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698598469764 (+910 ms)Consolidate snapshot: snaptb-1698598468809 at 1698598469764Loading Region manifests for snaptb-1698598468809 at 1698598469764Writing data manifest for snaptb-1698598468809 at 1698598469778 (+14 ms)Verifying snapshot: snaptb-1698598468809 at 1698598470189 (+411 ms)Snapshot snaptb-1698598468809 of table testCompactionWithHFileLink completed at 1698598470217 (+28 ms) 2023-10-29 16:54:30,219 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 16:54:30,220 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3640 sec 2023-10-29 16:54:30,824 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:30,974 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:30,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:30,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 16:54:31,021 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:31,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:31,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 16:54:31,024 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 16:54:31,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:31,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 16:54:31,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 16:54:31,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:31,024 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:31,025 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:31,025 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:31,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:31,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:31,026 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:31,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:31,026 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:31,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:31,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 16:54:31,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 16:54:31,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 16:54:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 16:54:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. started... 2023-10-29 16:54:31,029 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5654fa8c3658e7e7b12d603407068476 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:31,029 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. started... 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:31,029 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2de4f508daf224aaf110e9ea7a56b9d5 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:31,029 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:31,029 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. started... 2023-10-29 16:54:31,030 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 85653a47b2e3f679e9493cdd405920d6 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:31,859 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/0af8b621d67f4087936fd81253f39dd6 2023-10-29 16:54:31,862 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/ffea39ecb371489297f70f96259fa758 2023-10-29 16:54:31,863 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/6ffd57733217427b9b77d604baab0431 2023-10-29 16:54:31,870 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0af8b621d67f4087936fd81253f39dd6 2023-10-29 16:54:31,870 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ffd57733217427b9b77d604baab0431 2023-10-29 16:54:31,871 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffea39ecb371489297f70f96259fa758 2023-10-29 16:54:32,701 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/58cda870b9b0492b86646ff49345c768 2023-10-29 16:54:32,701 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/36bec416d1b846ef9cd8fb0dc9d1a83e 2023-10-29 16:54:32,702 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/cab051d1039f4bb29634ebe80f042ee0 2023-10-29 16:54:32,708 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58cda870b9b0492b86646ff49345c768 2023-10-29 16:54:32,709 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab051d1039f4bb29634ebe80f042ee0 2023-10-29 16:54:32,709 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36bec416d1b846ef9cd8fb0dc9d1a83e 2023-10-29 16:54:32,710 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/ffea39ecb371489297f70f96259fa758 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758 2023-10-29 16:54:32,710 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/0af8b621d67f4087936fd81253f39dd6 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6 2023-10-29 16:54:32,710 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/6ffd57733217427b9b77d604baab0431 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ffd57733217427b9b77d604baab0431 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffea39ecb371489297f70f96259fa758 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0af8b621d67f4087936fd81253f39dd6 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,714 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,715 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/36bec416d1b846ef9cd8fb0dc9d1a83e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e 2023-10-29 16:54:32,715 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/58cda870b9b0492b86646ff49345c768 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768 2023-10-29 16:54:32,715 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/cab051d1039f4bb29634ebe80f042ee0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab051d1039f4bb29634ebe80f042ee0 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 58cda870b9b0492b86646ff49345c768 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36bec416d1b846ef9cd8fb0dc9d1a83e 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5654fa8c3658e7e7b12d603407068476 in 1690ms, sequenceid=24, compaction requested=true 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 85653a47b2e3f679e9493cdd405920d6 in 1690ms, sequenceid=24, compaction requested=true 2023-10-29 16:54:32,719 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2de4f508daf224aaf110e9ea7a56b9d5 in 1690ms, sequenceid=24, compaction requested=true 2023-10-29 16:54:32,719 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:32,719 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:32,719 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:32,719 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:32,720 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:32,720 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 16:54:32,720 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 16:54:32,721 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:32,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,722 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:32,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 16:54:32,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51b9e7d8[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:32,723 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 16:54:32,723 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,724 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 16:54:32,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 16:54:32,724 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:32,724 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,724 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:32,725 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 16:54:32,725 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,725 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:32,725 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 16:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:32,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 16:54:32,727 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 16:54:32,727 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:32,727 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:32,727 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 16:54:32,727 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:32,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:32,728 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:32,729 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,730 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 16:54:32,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,732 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,732 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:32,732 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:32,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:32,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:32,732 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:32,732 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:32,732 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 16:54:32,733 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:32,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:32,732 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 16:54:32,733 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 16:54:32,833 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:32,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:32,835 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:32,836 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 5654fa8c3658e7e7b12d603407068476/family1 is initiating major compaction (all files) 2023-10-29 16:54:32,836 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:32,836 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:32,836 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 5654fa8c3658e7e7b12d603407068476/family1 in testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:32,837 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp, totalSize=26.7 K 2023-10-29 16:54:32,838 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting a1a7b814e3c241a9995049ece894b842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:32,839 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 066e67aad44a4438867dd3f25bc173c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463334 2023-10-29 16:54:32,839 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 82bf3735c53148c791cc957920d4b53a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465160 2023-10-29 16:54:32,840 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 880165afa0d74aceab8ae9bfabb2600d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466990 2023-10-29 16:54:32,841 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ffea39ecb371489297f70f96259fa758, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:32,863 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 5654fa8c3658e7e7b12d603407068476#family1#compaction#107 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:33,273 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del 2023-10-29 16:54:33,273 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del 2023-10-29 16:54:33,693 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91515584f10448479a105299c7b307fe 2023-10-29 16:54:33,694 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/91515584f10448479a105299c7b307fe as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/91515584f10448479a105299c7b307fe 2023-10-29 16:54:33,699 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 91515584f10448479a105299c7b307fe 2023-10-29 16:54:33,700 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5654fa8c3658e7e7b12d603407068476/family1 of 5654fa8c3658e7e7b12d603407068476 into 91515584f10448479a105299c7b307fe(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:33,700 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:33,700 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:33,700 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 5654fa8c3658e7e7b12d603407068476/family2 is initiating major compaction (all files) 2023-10-29 16:54:33,701 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:33,701 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:33,701 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 5654fa8c3658e7e7b12d603407068476/family2 in testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:33,702 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp, totalSize=25.4 K 2023-10-29 16:54:33,702 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b7744e3cdad1417da9a3f01a407f88f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:33,703 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting cb5a1d70e99641418e339461be3adad6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463334 2023-10-29 16:54:33,704 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 5d59d55e0be948b0b3944502a368009b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465160 2023-10-29 16:54:33,704 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting fecf64228a09408498d552796bcaf41d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466990 2023-10-29 16:54:33,704 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 58cda870b9b0492b86646ff49345c768, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:33,730 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 5654fa8c3658e7e7b12d603407068476#family2#compaction#108 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:33,746 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del 2023-10-29 16:54:33,746 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del 2023-10-29 16:54:33,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758] to archive 2023-10-29 16:54:33,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:33,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/a1a7b814e3c241a9995049ece894b842 2023-10-29 16:54:33,786 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/066e67aad44a4438867dd3f25bc173c4 2023-10-29 16:54:33,787 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/82bf3735c53148c791cc957920d4b53a 2023-10-29 16:54:33,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/880165afa0d74aceab8ae9bfabb2600d 2023-10-29 16:54:33,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/ffea39ecb371489297f70f96259fa758 2023-10-29 16:54:34,564 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e332acd6006e45fdb204647c0ee69e03 2023-10-29 16:54:34,565 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/e332acd6006e45fdb204647c0ee69e03 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/e332acd6006e45fdb204647c0ee69e03 2023-10-29 16:54:34,570 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e332acd6006e45fdb204647c0ee69e03 2023-10-29 16:54:34,571 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5654fa8c3658e7e7b12d603407068476/family2 of 5654fa8c3658e7e7b12d603407068476 into e332acd6006e45fdb204647c0ee69e03(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:34,571 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:34,571 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:34,571 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 85653a47b2e3f679e9493cdd405920d6/family1 is initiating major compaction (all files) 2023-10-29 16:54:34,571 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:34,571 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:34,572 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 85653a47b2e3f679e9493cdd405920d6/family1 in testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:34,572 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp, totalSize=26.7 K 2023-10-29 16:54:34,573 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b412fdb907c940c1a5aa400eac404852, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:34,573 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 09a224582b084557aef9f42f91686c37, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:34,574 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 22b52671071a4d14ba7e25378b464937, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:34,574 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting d25c8b1c39ee481bb8543a1cebe81b54, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:34,574 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6ffd57733217427b9b77d604baab0431, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:34,582 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768] to archive 2023-10-29 16:54:34,583 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:34,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/b7744e3cdad1417da9a3f01a407f88f8 2023-10-29 16:54:34,587 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/cb5a1d70e99641418e339461be3adad6 2023-10-29 16:54:34,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/5d59d55e0be948b0b3944502a368009b 2023-10-29 16:54:34,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/fecf64228a09408498d552796bcaf41d 2023-10-29 16:54:34,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/58cda870b9b0492b86646ff49345c768 2023-10-29 16:54:34,604 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 85653a47b2e3f679e9493cdd405920d6#family1#compaction#109 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:35,020 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del 2023-10-29 16:54:35,021 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del 2023-10-29 16:54:35,839 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fbcdb572dc1453da05c14a7f603aab1 2023-10-29 16:54:35,841 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/7fbcdb572dc1453da05c14a7f603aab1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/7fbcdb572dc1453da05c14a7f603aab1 2023-10-29 16:54:35,847 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fbcdb572dc1453da05c14a7f603aab1 2023-10-29 16:54:35,848 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 85653a47b2e3f679e9493cdd405920d6/family1 of 85653a47b2e3f679e9493cdd405920d6 into 7fbcdb572dc1453da05c14a7f603aab1(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:35,848 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:35,849 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:35,849 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 85653a47b2e3f679e9493cdd405920d6/family2 is initiating major compaction (all files) 2023-10-29 16:54:35,849 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:35,849 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:35,849 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 85653a47b2e3f679e9493cdd405920d6/family2 in testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:35,849 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp, totalSize=25.4 K 2023-10-29 16:54:35,850 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ffebc3cf1a8149b2828d66ef747cd75d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:35,850 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 59ee49e46505455e8f04343be7d3d3b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:35,851 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 34456cfe9f964133a63ddf498182ed5c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:35,851 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 76ec7635f3494eaa8de39d051f401d0c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:35,852 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 36bec416d1b846ef9cd8fb0dc9d1a83e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:35,866 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 85653a47b2e3f679e9493cdd405920d6#family2#compaction#110 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:35,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431] to archive 2023-10-29 16:54:35,882 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:35,884 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/b412fdb907c940c1a5aa400eac404852 2023-10-29 16:54:35,885 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/09a224582b084557aef9f42f91686c37 2023-10-29 16:54:35,886 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/22b52671071a4d14ba7e25378b464937 2023-10-29 16:54:35,887 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d25c8b1c39ee481bb8543a1cebe81b54 2023-10-29 16:54:35,888 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/6ffd57733217427b9b77d604baab0431 2023-10-29 16:54:36,281 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del 2023-10-29 16:54:36,282 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del 2023-10-29 16:54:37,120 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df719c11d29b4ade8323a8c175b8bfe4 2023-10-29 16:54:37,122 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/df719c11d29b4ade8323a8c175b8bfe4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/df719c11d29b4ade8323a8c175b8bfe4 2023-10-29 16:54:37,130 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for df719c11d29b4ade8323a8c175b8bfe4 2023-10-29 16:54:37,131 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 85653a47b2e3f679e9493cdd405920d6/family2 of 85653a47b2e3f679e9493cdd405920d6 into df719c11d29b4ade8323a8c175b8bfe4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:37,131 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:37,131 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:37,131 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 2de4f508daf224aaf110e9ea7a56b9d5/family1 is initiating major compaction (all files) 2023-10-29 16:54:37,131 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:37,131 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:37,132 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 2de4f508daf224aaf110e9ea7a56b9d5/family1 in testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:37,132 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp, totalSize=26.7 K 2023-10-29 16:54:37,132 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting a12cbd737b11473fa4ec394b7998beb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461929 2023-10-29 16:54:37,133 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 53d8d8e6c7e740caa1db8a27424bafde, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:37,133 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b28bcaa8021f455cb939e556e385a156, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:37,134 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 09fa196f24054456a0f0c25949b86cc0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:37,134 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0af8b621d67f4087936fd81253f39dd6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:37,151 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 2de4f508daf224aaf110e9ea7a56b9d5#family1#compaction#111 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:37,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e] to archive 2023-10-29 16:54:37,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:37,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/ffebc3cf1a8149b2828d66ef747cd75d 2023-10-29 16:54:37,187 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/59ee49e46505455e8f04343be7d3d3b4 2023-10-29 16:54:37,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/34456cfe9f964133a63ddf498182ed5c 2023-10-29 16:54:37,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/76ec7635f3494eaa8de39d051f401d0c 2023-10-29 16:54:37,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/36bec416d1b846ef9cd8fb0dc9d1a83e 2023-10-29 16:54:37,571 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del 2023-10-29 16:54:37,571 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del 2023-10-29 16:54:38,401 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 598d22ddbca0443ea9b67db68ce283e1 2023-10-29 16:54:38,402 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/598d22ddbca0443ea9b67db68ce283e1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/598d22ddbca0443ea9b67db68ce283e1 2023-10-29 16:54:38,408 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 598d22ddbca0443ea9b67db68ce283e1 2023-10-29 16:54:38,409 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2de4f508daf224aaf110e9ea7a56b9d5/family1 of 2de4f508daf224aaf110e9ea7a56b9d5 into 598d22ddbca0443ea9b67db68ce283e1(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:38,409 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:38,409 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:38,409 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 2de4f508daf224aaf110e9ea7a56b9d5/family2 is initiating major compaction (all files) 2023-10-29 16:54:38,409 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:38,409 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:38,409 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 2de4f508daf224aaf110e9ea7a56b9d5/family2 in testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:38,409 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp, totalSize=25.4 K 2023-10-29 16:54:38,410 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting cb008d1d293c41c98f9e05d4fc001ebb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461929 2023-10-29 16:54:38,411 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 9af96b69c9eb41a484e1f814d3683ad6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:38,411 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4de9a64c612f4e8a9cfe094711d749cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:38,412 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting d389242a5c3a49249052c24023d3e7a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:38,413 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting cab051d1039f4bb29634ebe80f042ee0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 16:54:38,425 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 2de4f508daf224aaf110e9ea7a56b9d5#family2#compaction#112 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:38,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6] to archive 2023-10-29 16:54:38,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:38,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/a12cbd737b11473fa4ec394b7998beb2 2023-10-29 16:54:38,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/53d8d8e6c7e740caa1db8a27424bafde 2023-10-29 16:54:38,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/b28bcaa8021f455cb939e556e385a156 2023-10-29 16:54:38,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/09fa196f24054456a0f0c25949b86cc0 2023-10-29 16:54:38,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/0af8b621d67f4087936fd81253f39dd6 2023-10-29 16:54:38,841 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del 2023-10-29 16:54:38,841 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del 2023-10-29 16:54:39,674 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d99800341b44da4bfdedc88394ff209 2023-10-29 16:54:39,675 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/5d99800341b44da4bfdedc88394ff209 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/5d99800341b44da4bfdedc88394ff209 2023-10-29 16:54:39,678 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d99800341b44da4bfdedc88394ff209 2023-10-29 16:54:39,679 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2de4f508daf224aaf110e9ea7a56b9d5/family2 of 2de4f508daf224aaf110e9ea7a56b9d5 into 5d99800341b44da4bfdedc88394ff209(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:39,679 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:39,684 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:39,688 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:39,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0] to archive 2023-10-29 16:54:39,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:39,695 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:39,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cb008d1d293c41c98f9e05d4fc001ebb 2023-10-29 16:54:39,696 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:39,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/9af96b69c9eb41a484e1f814d3683ad6 2023-10-29 16:54:39,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/4de9a64c612f4e8a9cfe094711d749cc 2023-10-29 16:54:39,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/d389242a5c3a49249052c24023d3e7a3 2023-10-29 16:54:39,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/cab051d1039f4bb29634ebe80f042ee0 2023-10-29 16:54:39,703 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:54:39,737 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 16:54:39,740 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del 2023-10-29 16:54:39,742 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del 2023-10-29 16:54:39,745 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del 2023-10-29 16:54:39,746 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:39,747 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(139): Connect 0x780d95e7 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:39,751 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68222e90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:39,751 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:39,751 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:39,751 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:40,210 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e 2023-10-29 16:54:40,211 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,212 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b 2023-10-29 16:54:40,213 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567 2023-10-29 16:54:40,213 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,213 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,223 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:40,225 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45498, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:40,231 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:54:40,232 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:54:40,245 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37d759cd6de140749a490d3bd637fd3d first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 16:54:40,245 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/62c6c400d34b4b3e87f2062f598d29eb first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 16:54:40,245 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 16:54:40,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37d759cd6de140749a490d3bd637fd3d}] 2023-10-29 16:54:40,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/62c6c400d34b4b3e87f2062f598d29eb}] 2023-10-29 16:54:40,247 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0}] 2023-10-29 16:54:40,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 for inclusion in 5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:40,252 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37d759cd6de140749a490d3bd637fd3d for inclusion in 85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:40,253 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/62c6c400d34b4b3e87f2062f598d29eb for inclusion in 2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:40,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:40,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37d759cd6de140749a490d3bd637fd3d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__2qpknn0tnuo9b41ns1meg1n301spmkv1lcvi7d9gvir3l3pckfbv309m4ecioshi/family1/37d759cd6de140749a490d3bd637fd3d 2023-10-29 16:54:40,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__7v41o28dc65hdgfiofgtgvcdcl03g1fveara2rgh8e924ai9rbr66pibg7g3s4qb/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 2023-10-29 16:54:40,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/62c6c400d34b4b3e87f2062f598d29eb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__h2cibr7hp0u4qqjpl1o0ndgeubdl9g4gfu13hovdimo4b9sfvalff4gmleusabh6/family1/62c6c400d34b4b3e87f2062f598d29eb 2023-10-29 16:54:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__2qpknn0tnuo9b41ns1meg1n301spmkv1lcvi7d9gvir3l3pckfbv309m4ecioshi/family1/37d759cd6de140749a490d3bd637fd3d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ 2023-10-29 16:54:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__h2cibr7hp0u4qqjpl1o0ndgeubdl9g4gfu13hovdimo4b9sfvalff4gmleusabh6/family1/62c6c400d34b4b3e87f2062f598d29eb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ 2023-10-29 16:54:40,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__7v41o28dc65hdgfiofgtgvcdcl03g1fveara2rgh8e924ai9rbr66pibg7g3s4qb/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ 2023-10-29 16:54:40,259 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__2qpknn0tnuo9b41ns1meg1n301spmkv1lcvi7d9gvir3l3pckfbv309m4ecioshi/family1/37d759cd6de140749a490d3bd637fd3d into 85653a47b2e3f679e9493cdd405920d6/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ - updating store file list. 2023-10-29 16:54:40,259 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__h2cibr7hp0u4qqjpl1o0ndgeubdl9g4gfu13hovdimo4b9sfvalff4gmleusabh6/family1/62c6c400d34b4b3e87f2062f598d29eb into 2de4f508daf224aaf110e9ea7a56b9d5/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ - updating store file list. 2023-10-29 16:54:40,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__7v41o28dc65hdgfiofgtgvcdcl03g1fveara2rgh8e924ai9rbr66pibg7g3s4qb/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 into 5654fa8c3658e7e7b12d603407068476/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ - updating store file list. 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ into 2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ into 85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__h2cibr7hp0u4qqjpl1o0ndgeubdl9g4gfu13hovdimo4b9sfvalff4gmleusabh6/family1/62c6c400d34b4b3e87f2062f598d29eb into 2de4f508daf224aaf110e9ea7a56b9d5/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_) 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ into 5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__2qpknn0tnuo9b41ns1meg1n301spmkv1lcvi7d9gvir3l3pckfbv309m4ecioshi/family1/37d759cd6de140749a490d3bd637fd3d into 85653a47b2e3f679e9493cdd405920d6/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_) 2023-10-29 16:54:40,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__7v41o28dc65hdgfiofgtgvcdcl03g1fveara2rgh8e924ai9rbr66pibg7g3s4qb/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 into 5654fa8c3658e7e7b12d603407068476/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_) 2023-10-29 16:54:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__h2cibr7hp0u4qqjpl1o0ndgeubdl9g4gfu13hovdimo4b9sfvalff4gmleusabh6/family1/62c6c400d34b4b3e87f2062f598d29eb 2023-10-29 16:54:40,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__2qpknn0tnuo9b41ns1meg1n301spmkv1lcvi7d9gvir3l3pckfbv309m4ecioshi/family1/37d759cd6de140749a490d3bd637fd3d 2023-10-29 16:54:40,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__7v41o28dc65hdgfiofgtgvcdcl03g1fveara2rgh8e924ai9rbr66pibg7g3s4qb/family1/a5cb0cf8ca6f4addbea4a3f0a193d9b0 2023-10-29 16:54:40,265 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,266 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,266 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,266 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,266 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,266 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,267 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 2023-10-29 16:54:40,267 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 2023-10-29 16:54:40,268 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 2023-10-29 16:54:40,268 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff 2023-10-29 16:54:40,268 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 2023-10-29 16:54:40,268 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 2023-10-29 16:54:40,269 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 2023-10-29 16:54:40,269 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 2023-10-29 16:54:40,269 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 2023-10-29 16:54:40,270 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 16:54:40,270 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b 2023-10-29 16:54:40,270 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:40,270 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 16:54:40,271 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:40,271 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:40,271 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:40,271 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:40,271 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:40,271 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del] 2023-10-29 16:54:40,272 DEBUG [Listener at localhost/45209] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,273 DEBUG [Listener at localhost/45209] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102951255e9e10104318a4bd0b81eb974977_del 2023-10-29 16:54:40,273 INFO [Listener at localhost/45209] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 16:54:40,273 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del] 2023-10-29 16:54:40,273 DEBUG [Listener at localhost/45209] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,275 DEBUG [Listener at localhost/45209] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef437cd1d89a4a6a89b25584921cf1d8_del 2023-10-29 16:54:40,275 INFO [Listener at localhost/45209] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 16:54:40,275 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del] 2023-10-29 16:54:40,275 DEBUG [Listener at localhost/45209] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:40,276 DEBUG [Listener at localhost/45209] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102904f8d4b757d745b39daa0f3754f2da9b_del 2023-10-29 16:54:40,276 INFO [Listener at localhost/45209] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 16:54:40,280 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:40,282 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:40,287 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:40,288 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:40,293 INFO [Listener at localhost/45209] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-29 16:54:40,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-10-29 16:54:40,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-29 16:54:40,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 16:54:40,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598480296"}]},"ts":"1698598480296"} 2023-10-29 16:54:40,298 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-29 16:54:40,299 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-29 16:54:40,300 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, UNASSIGN}] 2023-10-29 16:54:40,301 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, UNASSIGN 2023-10-29 16:54:40,301 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, UNASSIGN 2023-10-29 16:54:40,301 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, UNASSIGN 2023-10-29 16:54:40,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:40,302 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:40,302 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:40,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598480301"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598480301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598480301"}]},"ts":"1698598480301"} 2023-10-29 16:54:40,302 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598480301"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598480301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598480301"}]},"ts":"1698598480301"} 2023-10-29 16:54:40,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598480301"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598480301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598480301"}]},"ts":"1698598480301"} 2023-10-29 16:54:40,303 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:40,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; CloseRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:40,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=89, state=RUNNABLE; CloseRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:40,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 16:54:40,454 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:40,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:40,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 85653a47b2e3f679e9493cdd405920d6, disabling compactions & flushes 2023-10-29 16:54:40,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:40,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:40,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. after waiting 0 ms 2023-10-29 16:54:40,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:40,462 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 16:54:40,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:40,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:40,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:40,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:40,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2de4f508daf224aaf110e9ea7a56b9d5, disabling compactions & flushes 2023-10-29 16:54:40,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:40,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:40,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. after waiting 0 ms 2023-10-29 16:54:40,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:40,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=CLOSED 2023-10-29 16:54:40,467 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598480467"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598480467"}]},"ts":"1698598480467"} 2023-10-29 16:54:40,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-29 16:54:40,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173 in 166 msec 2023-10-29 16:54:40,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 16:54:40,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, UNASSIGN in 172 msec 2023-10-29 16:54:40,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:40,475 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:40,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:40,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:40,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5654fa8c3658e7e7b12d603407068476, disabling compactions & flushes 2023-10-29 16:54:40,478 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:40,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:40,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. after waiting 0 ms 2023-10-29 16:54:40,478 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=CLOSED 2023-10-29 16:54:40,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:40,478 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598480478"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598480478"}]},"ts":"1698598480478"} 2023-10-29 16:54:40,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-10-29 16:54:40,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; CloseRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173 in 176 msec 2023-10-29 16:54:40,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, UNASSIGN in 181 msec 2023-10-29 16:54:40,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 16:54:40,483 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:40,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:40,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:40,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=CLOSED 2023-10-29 16:54:40,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598480485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598480485"}]},"ts":"1698598480485"} 2023-10-29 16:54:40,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=89 2023-10-29 16:54:40,487 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=89, state=SUCCESS; CloseRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173 in 182 msec 2023-10-29 16:54:40,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-10-29 16:54:40,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, UNASSIGN in 187 msec 2023-10-29 16:54:40,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598480489"}]},"ts":"1698598480489"} 2023-10-29 16:54:40,490 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-29 16:54:40,490 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-29 16:54:40,492 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 197 msec 2023-10-29 16:54:40,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 16:54:40,599 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-29 16:54:40,615 INFO [Listener at localhost/45209] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:40,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:40,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698598480616 (current time:1698598480616). 2023-10-29 16:54:40,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 16:54:40,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(139): Connect 0x519f03e0 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:40,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18d50532, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:40,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:40,625 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x519f03e0 to 127.0.0.1:61373 2023-10-29 16:54:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:40,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 16:54:40,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:40,630 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot, current working dir path: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698598468809-1698598480615 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 16:54:40,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:40,633 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:40,634 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698599080634 2023-10-29 16:54:40,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:40,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698598468809-1698598480615 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 16:54:40,634 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:40,634 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 16:54:40,734 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:40,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:40,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:40,739 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 16:54:40,939 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:40,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:40,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:40,942 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 16:54:41,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 16:54:41,049 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/598d22ddbca0443ea9b67db68ce283e1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_] hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/598d22ddbca0443ea9b67db68ce283e1 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/91515584f10448479a105299c7b307fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_] hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/91515584f10448479a105299c7b307fe 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/7fbcdb572dc1453da05c14a7f603aab1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_] hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/7fbcdb572dc1453da05c14a7f603aab1 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e] hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/5d99800341b44da4bfdedc88394ff209] hfiles 2023-10-29 16:54:41,052 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/5d99800341b44da4bfdedc88394ff209 2023-10-29 16:54:41,053 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/e332acd6006e45fdb204647c0ee69e03] hfiles 2023-10-29 16:54:41,053 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/e332acd6006e45fdb204647c0ee69e03 2023-10-29 16:54:41,053 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/df719c11d29b4ade8323a8c175b8bfe4] hfiles 2023-10-29 16:54:41,053 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/df719c11d29b4ade8323a8c175b8bfe4 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53] hfiles 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102907f4aa632797460a8cd15cd8d48cad71 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310295c90025650d6436a85807e2ff91131b8 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029f419ffc5c48d4f5c9572830807138ec6 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029ff870e54886a4f1ea65cd9e68bc971dd 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102913dc877389a34f83a8abe1eb662f0abc 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310299759fedc5645486ba7a09f56639771db 2023-10-29 16:54:41,059 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029f93e6de92841408686bfe3a70e4381fe 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029fd977a653c204d3f990fc6eac7aae7a8 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310293944f264ee0b4ee7a3f89994c6f1bdf6 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310296d78ea05e04346c1b0ed209fad6dab65 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0c57c5c933340e7a037d94a29de9db5 2023-10-29 16:54:41,060 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029c327c7c2afb54d298ea1aefed3685c53 2023-10-29 16:54:41,243 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:41,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:41,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:41,246 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 16:54:41,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-29 16:54:41,465 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:41,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:41,746 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:41,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:41,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 16:54:41,749 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 16:54:41,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698598468809-1698598480615 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:41,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698598468809-1698598480615 of table testCompactionWithHFileLink completed 2023-10-29 16:54:41,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:41,909 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:41,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698598468809-1698598480615 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698598480634Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698598481045 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698598468809-1698598480615 at 1698598481465 (+420 ms)Loading Region manifests for hbase-failsafe-snaptb-1698598468809-1698598480615 at 1698598481465Writing data manifest for hbase-failsafe-snaptb-1698598468809-1698598480615 at 1698598481475 (+10 ms)Verifying snapshot: hbase-failsafe-snaptb-1698598468809-1698598480615 at 1698598481886 (+411 ms)Snapshot hbase-failsafe-snaptb-1698598468809-1698598480615 of table testCompactionWithHFileLink completed at 1698598481908 (+22 ms) 2023-10-29 16:54:41,910 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 16:54:41,911 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2790 sec 2023-10-29 16:54:42,750 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 16:54:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 16:54:42,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698598468809-1698598480615 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 16:54:42,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698598468809" table: "testCompactionWithHFileLink" creation_time: 1698598468823 type: FLUSH version: 2 ttl: 0 ) 2023-10-29 16:54:42,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698598468809 as table=testCompactionWithHFileLink 2023-10-29 16:54:42,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 16:54:42,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 16:54:43,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 16:54:43,208 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 16:54:43,209 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 16:54:43,209 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 16:54:43,210 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 16:54:43,214 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698598468809" table: "testCompactionWithHFileLink" creation_time: 1698598468823 type: FLUSH version: 2 ttl: 0 2023-10-29 16:54:43,215 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink 2023-10-29 16:54:43,221 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-29 16:54:43,224 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029eced36d9583a4103b602aec45357d567 2023-10-29 16:54:43,226 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f5ef3d013808450999628fd99c6d6e6e 2023-10-29 16:54:43,227 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310290b1472f05c314d0aa4411bec5a6a284b 2023-10-29 16:54:43,227 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,232 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,235 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,238 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,240 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,242 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,245 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,247 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,249 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,251 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,254 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,257 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 of snapshot=snaptb-1698598468809 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 16:54:43,262 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029b5655e469a7344ae96e7e52bcc2ff1c3_del 2023-10-29 16:54:43,263 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310290610f1dace6d43d0b0f1c175552f429f_del 2023-10-29 16:54:43,264 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310296137679e2e8347b7ad0b2ea522b59087_del 2023-10-29 16:54:43,264 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,264 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,265 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,267 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/91515584f10448479a105299c7b307fe to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/91515584f10448479a105299c7b307fe 2023-10-29 16:54:43,268 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/63ecb7eee91843f7b5819287e353dddc_SeqId_29_ 2023-10-29 16:54:43,268 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/d6fd1b283ffd49d5b086030e0be80c27_SeqId_29_ 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/7fbcdb572dc1453da05c14a7f603aab1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/7fbcdb572dc1453da05c14a7f603aab1 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b412fdb907c940c1a5aa400eac404852 of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/9d180af3a14349c8b64fa80021d4afbc_SeqId_29_ 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a1a7b814e3c241a9995049ece894b842 of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/598d22ddbca0443ea9b67db68ce283e1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/598d22ddbca0443ea9b67db68ce283e1 2023-10-29 16:54:43,269 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a12cbd737b11473fa4ec394b7998beb2 of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,276 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 09a224582b084557aef9f42f91686c37 of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,276 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 066e67aad44a4438867dd3f25bc173c4 of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,277 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 53d8d8e6c7e740caa1db8a27424bafde of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,279 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 82bf3735c53148c791cc957920d4b53a of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,280 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 22b52671071a4d14ba7e25378b464937 of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,280 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b28bcaa8021f455cb939e556e385a156 of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,282 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 880165afa0d74aceab8ae9bfabb2600d of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,282 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d25c8b1c39ee481bb8543a1cebe81b54 of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,282 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 09fa196f24054456a0f0c25949b86cc0 of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/e332acd6006e45fdb204647c0ee69e03 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/e332acd6006e45fdb204647c0ee69e03 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b7744e3cdad1417da9a3f01a407f88f8 of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/df719c11d29b4ade8323a8c175b8bfe4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/df719c11d29b4ade8323a8c175b8bfe4 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/5d99800341b44da4bfdedc88394ff209 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/5d99800341b44da4bfdedc88394ff209 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ffebc3cf1a8149b2828d66ef747cd75d of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,286 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb008d1d293c41c98f9e05d4fc001ebb of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,295 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb5a1d70e99641418e339461be3adad6 of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,295 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9af96b69c9eb41a484e1f814d3683ad6 of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,295 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 59ee49e46505455e8f04343be7d3d3b4 of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,298 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5d59d55e0be948b0b3944502a368009b of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,298 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4de9a64c612f4e8a9cfe094711d749cc of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,298 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 34456cfe9f964133a63ddf498182ed5c of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,303 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fecf64228a09408498d552796bcaf41d of snapshot=snaptb-1698598468809 to region=5654fa8c3658e7e7b12d603407068476 table=testCompactionWithHFileLink 2023-10-29 16:54:43,303 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d389242a5c3a49249052c24023d3e7a3 of snapshot=snaptb-1698598468809 to region=2de4f508daf224aaf110e9ea7a56b9d5 table=testCompactionWithHFileLink 2023-10-29 16:54:43,304 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 76ec7635f3494eaa8de39d051f401d0c of snapshot=snaptb-1698598468809 to region=85653a47b2e3f679e9493cdd405920d6 table=testCompactionWithHFileLink 2023-10-29 16:54:43,306 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698598468809" table: "testCompactionWithHFileLink" creation_time: 1698598468823 type: FLUSH version: 2 ttl: 0 2023-10-29 16:54:43,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698598483307"}]},"ts":"9223372036854775807"} 2023-10-29 16:54:43,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698598483307"}]},"ts":"9223372036854775807"} 2023-10-29 16:54:43,307 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698598483307"}]},"ts":"9223372036854775807"} 2023-10-29 16:54:43,309 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-29 16:54:43,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2de4f508daf224aaf110e9ea7a56b9d5, NAME => 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 5654fa8c3658e7e7b12d603407068476, NAME => 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 85653a47b2e3f679e9493cdd405920d6, NAME => 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-29 16:54:43,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598483308"}]},"ts":"1698598483308"} 2023-10-29 16:54:43,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598483308"}]},"ts":"1698598483308"} 2023-10-29 16:54:43,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598483308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598483308"}]},"ts":"1698598483308"} 2023-10-29 16:54:43,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 16:54:43,310 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-29 16:54:43,310 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 2de4f508daf224aaf110e9ea7a56b9d5, NAME => 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 5654fa8c3658e7e7b12d603407068476, NAME => 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 85653a47b2e3f679e9493cdd405920d6, NAME => 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.', STARTKEY => '1', ENDKEY => '2'}] 2023-10-29 16:54:43,311 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698598468809 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-29 16:54:43,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698598468809" table: "testCompactionWithHFileLink" creation_time: 1698598468823 type: FLUSH version: 2 ttl: 0 ) in 521 msec 2023-10-29 16:54:43,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 16:54:43,407 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-29 16:54:43,407 INFO [Listener at localhost/45209] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:43,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1698598468809-1698598480615" 2023-10-29 16:54:43,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698598468809-1698598480615 2023-10-29 16:54:43,421 INFO [Listener at localhost/45209] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-29 16:54:43,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-10-29 16:54:43,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-29 16:54:43,432 INFO [PEWorker-2] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-29 16:54:43,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 16:54:43,432 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598483432"}]},"ts":"1698598483432"} 2023-10-29 16:54:43,433 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 16:54:43,435 DEBUG [PEWorker-2] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-29 16:54:43,435 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN}] 2023-10-29 16:54:43,437 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN 2023-10-29 16:54:43,437 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN 2023-10-29 16:54:43,437 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN 2023-10-29 16:54:43,437 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 16:54:43,437 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 16:54:43,438 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 16:54:43,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 16:54:43,592 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,592 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,592 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598483592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598483592"}]},"ts":"1698598483592"} 2023-10-29 16:54:43,593 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598483592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598483592"}]},"ts":"1698598483592"} 2023-10-29 16:54:43,592 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,593 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598483592"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598483592"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598483592"}]},"ts":"1698598483592"} 2023-10-29 16:54:43,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:43,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:43,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:43,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 16:54:43,747 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:43,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5654fa8c3658e7e7b12d603407068476, NAME => 'testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 16:54:43,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:43,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,755 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,757 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:43,757 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:43,758 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5654fa8c3658e7e7b12d603407068476 columnFamilyName family1 2023-10-29 16:54:43,776 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4 2023-10-29 16:54:43,785 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a 2023-10-29 16:54:43,792 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d 2023-10-29 16:54:43,799 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842 2023-10-29 16:54:43,800 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(310): Store=5654fa8c3658e7e7b12d603407068476/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,800 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,801 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2 2023-10-29 16:54:43,801 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2 2023-10-29 16:54:43,801 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5654fa8c3658e7e7b12d603407068476 columnFamilyName family2 2023-10-29 16:54:43,810 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b 2023-10-29 16:54:43,815 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8 2023-10-29 16:54:43,819 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6 2023-10-29 16:54:43,825 DEBUG [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d 2023-10-29 16:54:43,825 INFO [StoreOpener-5654fa8c3658e7e7b12d603407068476-1] regionserver.HStore(310): Store=5654fa8c3658e7e7b12d603407068476/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:43,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:54:43,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5654fa8c3658e7e7b12d603407068476; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63840434, jitterRate=-0.048703402280807495}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:43,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:43,831 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., pid=102, masterSystemTime=1698598483747 2023-10-29 16:54:43,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 16:54:43,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 16:54:43,832 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 16:54:43,832 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 16:54:43,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:43,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:43,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:43,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2de4f508daf224aaf110e9ea7a56b9d5, NAME => 'testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 16:54:43,834 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=5654fa8c3658e7e7b12d603407068476, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,835 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483834"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598483834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598483834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598483834"}]},"ts":"1698598483834"} 2023-10-29 16:54:43,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:43,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,835 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 16:54:43,835 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 16:54:43,835 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1912): 5654fa8c3658e7e7b12d603407068476/family1 is initiating minor compaction (all files) 2023-10-29 16:54:43,836 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5654fa8c3658e7e7b12d603407068476/family1 in testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:43,835 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1912): 5654fa8c3658e7e7b12d603407068476/family2 is initiating minor compaction (all files) 2023-10-29 16:54:43,836 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp, totalSize=21.6 K 2023-10-29 16:54:43,836 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 5654fa8c3658e7e7b12d603407068476/family2 in testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:54:43,836 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp, totalSize=20.4 K 2023-10-29 16:54:43,836 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,836 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:43,837 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:43,837 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463334 2023-10-29 16:54:43,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-10-29 16:54:43,838 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:43,838 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463334 2023-10-29 16:54:43,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 5654fa8c3658e7e7b12d603407068476, server=jenkins-hbase20.apache.org,43165,1698598366173 in 240 msec 2023-10-29 16:54:43,838 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:43,838 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465160 2023-10-29 16:54:43,839 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4f508daf224aaf110e9ea7a56b9d5 columnFamilyName family1 2023-10-29 16:54:43,839 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465160 2023-10-29 16:54:43,839 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=5654fa8c3658e7e7b12d603407068476, ASSIGN in 403 msec 2023-10-29 16:54:43,839 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466990 2023-10-29 16:54:43,840 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466990 2023-10-29 16:54:43,853 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0 2023-10-29 16:54:43,863 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde 2023-10-29 16:54:43,871 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2 2023-10-29 16:54:43,881 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] throttle.PressureAwareThroughputController(145): 5654fa8c3658e7e7b12d603407068476#family2#compaction#113 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:43,882 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156 2023-10-29 16:54:43,886 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(310): Store=2de4f508daf224aaf110e9ea7a56b9d5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,886 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5654fa8c3658e7e7b12d603407068476#family1#compaction#114 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:43,887 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,888 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2 2023-10-29 16:54:43,888 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2 2023-10-29 16:54:43,888 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4f508daf224aaf110e9ea7a56b9d5 columnFamilyName family2 2023-10-29 16:54:43,894 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc 2023-10-29 16:54:43,898 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6 2023-10-29 16:54:43,902 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb 2023-10-29 16:54:43,907 DEBUG [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3 2023-10-29 16:54:43,907 INFO [StoreOpener-2de4f508daf224aaf110e9ea7a56b9d5-1] regionserver.HStore(310): Store=2de4f508daf224aaf110e9ea7a56b9d5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:43,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:54:43,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2de4f508daf224aaf110e9ea7a56b9d5; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71547771, jitterRate=0.06614486873149872}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:43,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., pid=101, masterSystemTime=1698598483747 2023-10-29 16:54:43,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 16:54:43,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-29 16:54:43,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:43,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:43,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:43,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 85653a47b2e3f679e9493cdd405920d6, NAME => 'testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 16:54:43,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=2de4f508daf224aaf110e9ea7a56b9d5, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,916 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698598483915"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598483915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598483915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598483915"}]},"ts":"1698598483915"} 2023-10-29 16:54:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,917 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,918 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:43,918 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:43,919 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85653a47b2e3f679e9493cdd405920d6 columnFamilyName family1 2023-10-29 16:54:43,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-29 16:54:43,919 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 2de4f508daf224aaf110e9ea7a56b9d5, server=jenkins-hbase20.apache.org,43165,1698598366173 in 322 msec 2023-10-29 16:54:43,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2de4f508daf224aaf110e9ea7a56b9d5, ASSIGN in 484 msec 2023-10-29 16:54:43,927 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37 2023-10-29 16:54:43,936 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937 2023-10-29 16:54:43,946 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852 2023-10-29 16:54:43,952 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54 2023-10-29 16:54:43,952 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(310): Store=85653a47b2e3f679e9493cdd405920d6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,953 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,953 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2 2023-10-29 16:54:43,953 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2 2023-10-29 16:54:43,954 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 85653a47b2e3f679e9493cdd405920d6 columnFamilyName family2 2023-10-29 16:54:43,962 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c 2023-10-29 16:54:43,969 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4 2023-10-29 16:54:43,981 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c 2023-10-29 16:54:43,988 DEBUG [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(539): loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d 2023-10-29 16:54:43,989 INFO [StoreOpener-85653a47b2e3f679e9493cdd405920d6-1] regionserver.HStore(310): Store=85653a47b2e3f679e9493cdd405920d6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:43,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:43,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:54:43,993 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 85653a47b2e3f679e9493cdd405920d6; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62425466, jitterRate=-0.06978806853294373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:43,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:43,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., pid=103, masterSystemTime=1698598483747 2023-10-29 16:54:43,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 16:54:43,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 16:54:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:43,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:43,995 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=85653a47b2e3f679e9493cdd405920d6, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:43,996 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598483995"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598483995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598483995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598483995"}]},"ts":"1698598483995"} 2023-10-29 16:54:43,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-10-29 16:54:43,998 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 85653a47b2e3f679e9493cdd405920d6, server=jenkins-hbase20.apache.org,43165,1698598366173 in 401 msec 2023-10-29 16:54:44,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=99, resume processing ppid=97 2023-10-29 16:54:44,000 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=85653a47b2e3f679e9493cdd405920d6, ASSIGN in 563 msec 2023-10-29 16:54:44,000 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598484000"}]},"ts":"1698598484000"} 2023-10-29 16:54:44,001 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 16:54:44,002 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-29 16:54:44,004 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 577 msec 2023-10-29 16:54:44,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 16:54:44,038 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-29 16:54:44,052 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:44,064 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:44,076 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:44,077 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:44,083 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:54:44,095 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 16:54:44,095 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:44,096 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(139): Connect 0x7b8824cf to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:44,100 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55221884, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:44,100 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:44,100 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:44,100 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:44,593 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029320e9a21b17b4d28809be6772c0e9d26 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029320e9a21b17b4d28809be6772c0e9d26 2023-10-29 16:54:44,594 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:44,608 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:54:44,611 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34460, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:54:44,618 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:54:44,621 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:54:44,633 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37929da3e0ef444182f556a942189651 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-29 16:54:44,634 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37929da3e0ef444182f556a942189651}] 2023-10-29 16:54:44,640 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37929da3e0ef444182f556a942189651 for inclusion in 85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:44,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-29 16:54:44,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 16:54:44,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:44,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/37929da3e0ef444182f556a942189651 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__93d95c1c2q7jremgs23cotljspl1e3g00e1k5p4017pk5o5hb8q7kphteuctvrui/family1/37929da3e0ef444182f556a942189651 2023-10-29 16:54:44,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__93d95c1c2q7jremgs23cotljspl1e3g00e1k5p4017pk5o5hb8q7kphteuctvrui/family1/37929da3e0ef444182f556a942189651 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_ 2023-10-29 16:54:44,647 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__93d95c1c2q7jremgs23cotljspl1e3g00e1k5p4017pk5o5hb8q7kphteuctvrui/family1/37929da3e0ef444182f556a942189651 into 85653a47b2e3f679e9493cdd405920d6/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_ - updating store file list. 2023-10-29 16:54:44,650 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_ into 85653a47b2e3f679e9493cdd405920d6/family1 2023-10-29 16:54:44,650 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__93d95c1c2q7jremgs23cotljspl1e3g00e1k5p4017pk5o5hb8q7kphteuctvrui/family1/37929da3e0ef444182f556a942189651 into 85653a47b2e3f679e9493cdd405920d6/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_) 2023-10-29 16:54:44,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__93d95c1c2q7jremgs23cotljspl1e3g00e1k5p4017pk5o5hb8q7kphteuctvrui/family1/37929da3e0ef444182f556a942189651 2023-10-29 16:54:44,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:44,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-29 16:54:44,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(1912): 85653a47b2e3f679e9493cdd405920d6/family1 is initiating minor compaction (all files) 2023-10-29 16:54:44,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7963bb80; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 16:54:44,654 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:44,655 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:44,656 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102943ca2d0177144447bf18ca47503b6013 2023-10-29 16:54:44,657 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023102961ef0715246b4116a21d03b1ad265fe8 2023-10-29 16:54:44,657 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310296a96b827329c43cab271140faed3de07 2023-10-29 16:54:44,658 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029b265e4a37c7b4d2e8b7fa6789341e471 2023-10-29 16:54:44,658 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:44,658 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 16:54:44,659 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:44,998 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029f24dc91811e0421180d6a9eb05b419a8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029f24dc91811e0421180d6a9eb05b419a8 2023-10-29 16:54:44,999 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:45,000 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291f8734606aff48c781345f69010cdcb5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291f8734606aff48c781345f69010cdcb5 2023-10-29 16:54:45,001 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:45,029 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/14c6f424d2a94e2d989d7c97e03d96b1 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-29 16:54:45,029 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9124bbbd7cec4a288ab08e93bd9d42c1 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-29 16:54:45,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=32 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/14c6f424d2a94e2d989d7c97e03d96b1}] 2023-10-29 16:54:45,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9124bbbd7cec4a288ab08e93bd9d42c1}] 2023-10-29 16:54:45,032 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/14c6f424d2a94e2d989d7c97e03d96b1 for inclusion in 5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:45,032 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9124bbbd7cec4a288ab08e93bd9d42c1 for inclusion in 2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:45,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-29 16:54:45,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-29 16:54:45,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 16:54:45,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 16:54:45,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:45,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9124bbbd7cec4a288ab08e93bd9d42c1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__80aok3c9gnjp81c42sipbafsiufki7jlmeh1rh237i2kogler8uo7rc5bi0nlsn3/family1/9124bbbd7cec4a288ab08e93bd9d42c1 2023-10-29 16:54:45,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/14c6f424d2a94e2d989d7c97e03d96b1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__6ndhvt2ph50mm0tcln78e9lpd5f11rinfgfgv7lsarkjla3n7vfrsodq7l7oh3a9/family1/14c6f424d2a94e2d989d7c97e03d96b1 2023-10-29 16:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__80aok3c9gnjp81c42sipbafsiufki7jlmeh1rh237i2kogler8uo7rc5bi0nlsn3/family1/9124bbbd7cec4a288ab08e93bd9d42c1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_ 2023-10-29 16:54:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__6ndhvt2ph50mm0tcln78e9lpd5f11rinfgfgv7lsarkjla3n7vfrsodq7l7oh3a9/family1/14c6f424d2a94e2d989d7c97e03d96b1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/3825524f29164284abd45761859c0163_SeqId_34_ 2023-10-29 16:54:45,038 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__6ndhvt2ph50mm0tcln78e9lpd5f11rinfgfgv7lsarkjla3n7vfrsodq7l7oh3a9/family1/14c6f424d2a94e2d989d7c97e03d96b1 into 5654fa8c3658e7e7b12d603407068476/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/3825524f29164284abd45761859c0163_SeqId_34_ - updating store file list. 2023-10-29 16:54:45,038 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__80aok3c9gnjp81c42sipbafsiufki7jlmeh1rh237i2kogler8uo7rc5bi0nlsn3/family1/9124bbbd7cec4a288ab08e93bd9d42c1 into 2de4f508daf224aaf110e9ea7a56b9d5/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_ - updating store file list. 2023-10-29 16:54:45,041 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_ into 2de4f508daf224aaf110e9ea7a56b9d5/family1 2023-10-29 16:54:45,041 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/3825524f29164284abd45761859c0163_SeqId_34_ into 5654fa8c3658e7e7b12d603407068476/family1 2023-10-29 16:54:45,041 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__80aok3c9gnjp81c42sipbafsiufki7jlmeh1rh237i2kogler8uo7rc5bi0nlsn3/family1/9124bbbd7cec4a288ab08e93bd9d42c1 into 2de4f508daf224aaf110e9ea7a56b9d5/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_) 2023-10-29 16:54:45,041 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__6ndhvt2ph50mm0tcln78e9lpd5f11rinfgfgv7lsarkjla3n7vfrsodq7l7oh3a9/family1/14c6f424d2a94e2d989d7c97e03d96b1 into 5654fa8c3658e7e7b12d603407068476/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/3825524f29164284abd45761859c0163_SeqId_34_) 2023-10-29 16:54:45,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__80aok3c9gnjp81c42sipbafsiufki7jlmeh1rh237i2kogler8uo7rc5bi0nlsn3/family1/9124bbbd7cec4a288ab08e93bd9d42c1 2023-10-29 16:54:45,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testCompactionWithHFileLink__6ndhvt2ph50mm0tcln78e9lpd5f11rinfgfgv7lsarkjla3n7vfrsodq7l7oh3a9/family1/14c6f424d2a94e2d989d7c97e03d96b1 2023-10-29 16:54:45,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:45,043 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:45,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-29 16:54:45,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(1912): 2de4f508daf224aaf110e9ea7a56b9d5/family1 is initiating minor compaction (all files) 2023-10-29 16:54:45,043 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:45,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1c316c7a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-29 16:54:45,045 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102933c45bc9b0d143f2b4ada08452d86349 2023-10-29 16:54:45,045 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:45,046 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:45,046 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310298e4e76428f5c4d6ca83b4978d2b1d0ff 2023-10-29 16:54:45,048 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029a8a520468b5541ee83389504a6695c45 2023-10-29 16:54:45,048 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023102910b40f34ca004e9ab10f07e646f03448 2023-10-29 16:54:45,049 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029ab379cdc40644fc5b804541514ab65d1 2023-10-29 16:54:45,049 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310296d7cacbf8bfa49cdbe782f3f77d74229 2023-10-29 16:54:45,049 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:45,049 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 16:54:45,049 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:45,050 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029ac154e6fd5f14b16bb4b4e47789938ba 2023-10-29 16:54:45,051 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029b525d0007f3c4aa39c531ae0c704597b 2023-10-29 16:54:45,051 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 16:54:45,051 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 16:54:45,051 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 16:54:45,051 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 16:54:45,054 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:45,056 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:45,059 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:45,060 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:45,066 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:45,067 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:45,080 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=287 (was 247) - Thread LEAK? -, OpenFileDescriptor=770 (was 628) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=126 (was 162), ProcessCount=168 (was 168), AvailableMemoryMB=2648 (was 2760) 2023-10-29 16:54:45,091 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=287, OpenFileDescriptor=770, MaxFileDescriptor=60000, SystemLoadAverage=126, ProcessCount=168, AvailableMemoryMB=2648 2023-10-29 16:54:45,096 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-10-29 16:54:45,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-29 16:54:45,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 16:54:45,103 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 16:54:45,105 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 7 msec 2023-10-29 16:54:45,108 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family1/8be44ef8e0fb4f578f8e0b139092c787 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/8be44ef8e0fb4f578f8e0b139092c787 2023-10-29 16:54:45,108 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/.tmp/family2/17bc14cf03a643668ba958a0e7d44c89 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/17bc14cf03a643668ba958a0e7d44c89 2023-10-29 16:54:45,112 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 16:54:45,112 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 5654fa8c3658e7e7b12d603407068476/family1 of 5654fa8c3658e7e7b12d603407068476 into 8be44ef8e0fb4f578f8e0b139092c787(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 5654fa8c3658e7e7b12d603407068476/family2 of 5654fa8c3658e7e7b12d603407068476 into 17bc14cf03a643668ba958a0e7d44c89(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:45,113 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:45,113 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., storeName=5654fa8c3658e7e7b12d603407068476/family1, priority=12, startTime=1698598483831; duration=1sec 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476., storeName=5654fa8c3658e7e7b12d603407068476/family2, priority=12, startTime=1698598483832; duration=1sec 2023-10-29 16:54:45,113 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-10-29 16:54:45,113 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 85653a47b2e3f679e9493cdd405920d6/family1 in testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 2de4f508daf224aaf110e9ea7a56b9d5/family1 in testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp, totalSize=28.9 K 2023-10-29 16:54:45,113 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp, totalSize=28.9 K 2023-10-29 16:54:45,114 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:45,114 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461929 2023-10-29 16:54:45,115 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:45,115 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:45,115 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:45,115 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:45,116 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:45,116 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:45,116 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698598461928 2023-10-29 16:54:45,116 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698598461929 2023-10-29 16:54:45,131 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 85653a47b2e3f679e9493cdd405920d6#family1#compaction#115 average throughput is 0.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:45,132 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] throttle.PressureAwareThroughputController(145): 2de4f508daf224aaf110e9ea7a56b9d5#family1#compaction#116 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:45,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d] to archive 2023-10-29 16:54:45,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:45,193 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-a1a7b814e3c241a9995049ece894b842 2023-10-29 16:54:45,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-066e67aad44a4438867dd3f25bc173c4 2023-10-29 16:54:45,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-82bf3735c53148c791cc957920d4b53a 2023-10-29 16:54:45,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family1/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-880165afa0d74aceab8ae9bfabb2600d 2023-10-29 16:54:45,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d] to archive 2023-10-29 16:54:45,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:45,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-b7744e3cdad1417da9a3f01a407f88f8 2023-10-29 16:54:45,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-cb5a1d70e99641418e339461be3adad6 2023-10-29 16:54:45,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-5d59d55e0be948b0b3944502a368009b 2023-10-29 16:54:45,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 16:54:45,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/family2/testCompactionWithHFileLink=5654fa8c3658e7e7b12d603407068476-fecf64228a09408498d552796bcaf41d 2023-10-29 16:54:45,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 16:54:45,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-29 16:54:45,207 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:54:45,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-29 16:54:45,208 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:54:45,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:45,210 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:45,210 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:45,211 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:45,211 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2 empty. 2023-10-29 16:54:45,211 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a empty. 2023-10-29 16:54:45,211 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1 empty. 2023-10-29 16:54:45,212 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:45,212 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:45,212 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:45,212 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-29 16:54:45,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:45,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:45,623 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 16:54:45,624 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b761645cf3c2b80fb2a3dad1481d3e2, NAME => 'ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:45,624 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => a777b792e0007c094a37fa7dd2191d3a, NAME => 'ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:45,624 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => fee1224f2bb118ba7ba19156a7ef88e1, NAME => 'ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing fee1224f2bb118ba7ba19156a7ef88e1, disabling compactions & flushes 2023-10-29 16:54:45,646 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. after waiting 0 ms 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:45,646 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:45,646 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:45,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:45,947 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family1/4859610d0a744abf8b8b7bb6615d7aff as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/4859610d0a744abf8b8b7bb6615d7aff 2023-10-29 16:54:45,951 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 85653a47b2e3f679e9493cdd405920d6/family1 of 85653a47b2e3f679e9493cdd405920d6 into 4859610d0a744abf8b8b7bb6615d7aff(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:45,951 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:45,951 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698598484653; duration=0sec 2023-10-29 16:54:45,951 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 16:54:45,951 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 16:54:45,953 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 16:54:45,953 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1912): 2de4f508daf224aaf110e9ea7a56b9d5/family2 is initiating minor compaction (all files) 2023-10-29 16:54:45,954 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2de4f508daf224aaf110e9ea7a56b9d5/family2 in testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:54:45,954 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp, totalSize=20.4 K 2023-10-29 16:54:45,954 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461929 2023-10-29 16:54:45,955 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:45,955 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:45,956 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:45,967 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2de4f508daf224aaf110e9ea7a56b9d5#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:45,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_] to archive 2023-10-29 16:54:45,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:45,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-b412fdb907c940c1a5aa400eac404852 2023-10-29 16:54:45,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-09a224582b084557aef9f42f91686c37 2023-10-29 16:54:45,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-22b52671071a4d14ba7e25378b464937 2023-10-29 16:54:45,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-d25c8b1c39ee481bb8543a1cebe81b54 2023-10-29 16:54:45,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family1/0b4585d6400046cfa8d333fdfc8ba19a_SeqId_34_ 2023-10-29 16:54:45,994 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:46,043 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:46,043 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 2b761645cf3c2b80fb2a3dad1481d3e2, disabling compactions & flushes 2023-10-29 16:54:46,043 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,043 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,044 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. after waiting 0 ms 2023-10-29 16:54:46,044 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,044 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,044 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:46,047 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:46,048 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing a777b792e0007c094a37fa7dd2191d3a, disabling compactions & flushes 2023-10-29 16:54:46,048 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,048 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,048 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. after waiting 0 ms 2023-10-29 16:54:46,048 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,048 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,048 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:46,050 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:54:46,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698598486051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598486051"}]},"ts":"1698598486051"} 2023-10-29 16:54:46,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598486051"}]},"ts":"1698598486051"} 2023-10-29 16:54:46,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598486051"}]},"ts":"1698598486051"} 2023-10-29 16:54:46,054 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 16:54:46,055 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:54:46,056 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598486055"}]},"ts":"1698598486055"} 2023-10-29 16:54:46,057 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-29 16:54:46,059 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2b761645cf3c2b80fb2a3dad1481d3e2, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fee1224f2bb118ba7ba19156a7ef88e1, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a777b792e0007c094a37fa7dd2191d3a, ASSIGN}] 2023-10-29 16:54:46,061 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2b761645cf3c2b80fb2a3dad1481d3e2, ASSIGN 2023-10-29 16:54:46,061 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a777b792e0007c094a37fa7dd2191d3a, ASSIGN 2023-10-29 16:54:46,061 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fee1224f2bb118ba7ba19156a7ef88e1, ASSIGN 2023-10-29 16:54:46,062 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2b761645cf3c2b80fb2a3dad1481d3e2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:46,062 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a777b792e0007c094a37fa7dd2191d3a, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:46,062 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fee1224f2bb118ba7ba19156a7ef88e1, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:54:46,214 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2b761645cf3c2b80fb2a3dad1481d3e2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fee1224f2bb118ba7ba19156a7ef88e1, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,214 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a777b792e0007c094a37fa7dd2191d3a, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698598486214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598486214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598486214"}]},"ts":"1698598486214"} 2023-10-29 16:54:46,214 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598486214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598486214"}]},"ts":"1698598486214"} 2023-10-29 16:54:46,214 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486214"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598486214"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598486214"}]},"ts":"1698598486214"} 2023-10-29 16:54:46,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure fee1224f2bb118ba7ba19156a7ef88e1, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:46,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure 2b761645cf3c2b80fb2a3dad1481d3e2, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:46,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=108, state=RUNNABLE; OpenRegionProcedure a777b792e0007c094a37fa7dd2191d3a, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:54:46,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:46,356 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family1/2d92fb2f24c9449881d683822bec545e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/2d92fb2f24c9449881d683822bec545e 2023-10-29 16:54:46,361 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 2de4f508daf224aaf110e9ea7a56b9d5/family1 of 2de4f508daf224aaf110e9ea7a56b9d5 into 2d92fb2f24c9449881d683822bec545e(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:46,361 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:46,361 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698598485043; duration=1sec 2023-10-29 16:54:46,362 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 16:54:46,362 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 16:54:46,364 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 16:54:46,364 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1912): 85653a47b2e3f679e9493cdd405920d6/family2 is initiating minor compaction (all files) 2023-10-29 16:54:46,364 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 85653a47b2e3f679e9493cdd405920d6/family2 in testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:54:46,364 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp, totalSize=20.4 K 2023-10-29 16:54:46,365 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598461928 2023-10-29 16:54:46,365 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598463335 2023-10-29 16:54:46,366 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598465161 2023-10-29 16:54:46,366 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598466991 2023-10-29 16:54:46,367 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b761645cf3c2b80fb2a3dad1481d3e2, NAME => 'ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 16:54:46,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:46,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,372 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,374 DEBUG [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1 2023-10-29 16:54:46,374 DEBUG [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1 2023-10-29 16:54:46,374 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b761645cf3c2b80fb2a3dad1481d3e2 columnFamilyName family1 2023-10-29 16:54:46,376 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] regionserver.HStore(310): Store=2b761645cf3c2b80fb2a3dad1481d3e2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,377 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,378 DEBUG [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2 2023-10-29 16:54:46,378 DEBUG [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2 2023-10-29 16:54:46,379 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b761645cf3c2b80fb2a3dad1481d3e2 columnFamilyName family2 2023-10-29 16:54:46,380 INFO [StoreOpener-2b761645cf3c2b80fb2a3dad1481d3e2-1] regionserver.HStore(310): Store=2b761645cf3c2b80fb2a3dad1481d3e2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,382 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_] to archive 2023-10-29 16:54:46,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:46,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:46,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-a12cbd737b11473fa4ec394b7998beb2 2023-10-29 16:54:46,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:54:46,385 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-53d8d8e6c7e740caa1db8a27424bafde 2023-10-29 16:54:46,386 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] throttle.PressureAwareThroughputController(145): 85653a47b2e3f679e9493cdd405920d6#family2#compaction#118 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-10-29 16:54:46,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:46,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-b28bcaa8021f455cb939e556e385a156 2023-10-29 16:54:46,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2b761645cf3c2b80fb2a3dad1481d3e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66918641, jitterRate=-0.0028345435857772827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:46,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:46,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-09fa196f24054456a0f0c25949b86cc0 2023-10-29 16:54:46,387 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2., pid=110, masterSystemTime=1698598486367 2023-10-29 16:54:46,388 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/.tmp/family2/17d042acda284e39b8bcf48c8e45fe41 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/17d042acda284e39b8bcf48c8e45fe41 2023-10-29 16:54:46,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family1/c400c8ee8fd64b27a05cf5088e5b473a_SeqId_34_ 2023-10-29 16:54:46,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:46,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:46,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fee1224f2bb118ba7ba19156a7ef88e1, NAME => 'ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 16:54:46,389 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2b761645cf3c2b80fb2a3dad1481d3e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:46,389 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486389"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598486389"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598486389"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598486389"}]},"ts":"1698598486389"} 2023-10-29 16:54:46,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,390 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,391 DEBUG [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1 2023-10-29 16:54:46,391 DEBUG [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1 2023-10-29 16:54:46,392 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fee1224f2bb118ba7ba19156a7ef88e1 columnFamilyName family1 2023-10-29 16:54:46,392 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2de4f508daf224aaf110e9ea7a56b9d5/family2 of 2de4f508daf224aaf110e9ea7a56b9d5 into 17d042acda284e39b8bcf48c8e45fe41(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:46,392 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:54:46,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=106 2023-10-29 16:54:46,392 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5., storeName=2de4f508daf224aaf110e9ea7a56b9d5/family2, priority=12, startTime=1698598483914; duration=0sec 2023-10-29 16:54:46,392 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure 2b761645cf3c2b80fb2a3dad1481d3e2, server=jenkins-hbase20.apache.org,43165,1698598366173 in 174 msec 2023-10-29 16:54:46,392 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-29 16:54:46,392 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-29 16:54:46,392 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] regionserver.HStore(310): Store=fee1224f2bb118ba7ba19156a7ef88e1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. because compaction request was cancelled 2023-10-29 16:54:46,393 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 16:54:46,393 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2b761645cf3c2b80fb2a3dad1481d3e2, ASSIGN in 333 msec 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 16:54:46,393 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. because compaction request was cancelled 2023-10-29 16:54:46,394 DEBUG [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2 2023-10-29 16:54:46,394 DEBUG [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2 2023-10-29 16:54:46,394 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fee1224f2bb118ba7ba19156a7ef88e1 columnFamilyName family2 2023-10-29 16:54:46,395 INFO [StoreOpener-fee1224f2bb118ba7ba19156a7ef88e1-1] regionserver.HStore(310): Store=fee1224f2bb118ba7ba19156a7ef88e1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:46,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:54:46,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:46,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fee1224f2bb118ba7ba19156a7ef88e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64667218, jitterRate=-0.036383360624313354}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:46,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:46,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1., pid=109, masterSystemTime=1698598486367 2023-10-29 16:54:46,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:46,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:46,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a777b792e0007c094a37fa7dd2191d3a, NAME => 'ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 16:54:46,400 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=fee1224f2bb118ba7ba19156a7ef88e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,401 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698598486400"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598486400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598486400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598486400"}]},"ts":"1698598486400"} 2023-10-29 16:54:46,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:54:46,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,402 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,403 DEBUG [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1 2023-10-29 16:54:46,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-10-29 16:54:46,403 DEBUG [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1 2023-10-29 16:54:46,403 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure fee1224f2bb118ba7ba19156a7ef88e1, server=jenkins-hbase20.apache.org,43165,1698598366173 in 186 msec 2023-10-29 16:54:46,403 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a777b792e0007c094a37fa7dd2191d3a columnFamilyName family1 2023-10-29 16:54:46,404 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=fee1224f2bb118ba7ba19156a7ef88e1, ASSIGN in 344 msec 2023-10-29 16:54:46,404 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] regionserver.HStore(310): Store=a777b792e0007c094a37fa7dd2191d3a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,404 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,405 DEBUG [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2 2023-10-29 16:54:46,405 DEBUG [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2 2023-10-29 16:54:46,405 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a777b792e0007c094a37fa7dd2191d3a columnFamilyName family2 2023-10-29 16:54:46,406 INFO [StoreOpener-a777b792e0007c094a37fa7dd2191d3a-1] regionserver.HStore(310): Store=a777b792e0007c094a37fa7dd2191d3a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:54:46,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:54:46,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:54:46,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:54:46,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a777b792e0007c094a37fa7dd2191d3a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74673484, jitterRate=0.11272162199020386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:54:46,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:46,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a., pid=111, masterSystemTime=1698598486367 2023-10-29 16:54:46,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:46,412 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a777b792e0007c094a37fa7dd2191d3a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:46,412 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698598486412"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598486412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598486412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598486412"}]},"ts":"1698598486412"} 2023-10-29 16:54:46,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=108 2023-10-29 16:54:46,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=108, state=SUCCESS; OpenRegionProcedure a777b792e0007c094a37fa7dd2191d3a, server=jenkins-hbase20.apache.org,43165,1698598366173 in 196 msec 2023-10-29 16:54:46,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=105 2023-10-29 16:54:46,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a777b792e0007c094a37fa7dd2191d3a, ASSIGN in 355 msec 2023-10-29 16:54:46,416 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:54:46,416 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598486416"}]},"ts":"1698598486416"} 2023-10-29 16:54:46,417 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-29 16:54:46,419 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:54:46,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2140 sec 2023-10-29 16:54:46,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3] to archive 2023-10-29 16:54:46,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:46,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-cb008d1d293c41c98f9e05d4fc001ebb 2023-10-29 16:54:46,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-9af96b69c9eb41a484e1f814d3683ad6 2023-10-29 16:54:46,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-4de9a64c612f4e8a9cfe094711d749cc 2023-10-29 16:54:46,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/family2/testCompactionWithHFileLink=2de4f508daf224aaf110e9ea7a56b9d5-d389242a5c3a49249052c24023d3e7a3 2023-10-29 16:54:47,209 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/.tmp/family2/646715271b9d431fa09bebe9c6068168 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/646715271b9d431fa09bebe9c6068168 2023-10-29 16:54:47,218 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 85653a47b2e3f679e9493cdd405920d6/family2 of 85653a47b2e3f679e9493cdd405920d6 into 646715271b9d431fa09bebe9c6068168(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:47,218 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:54:47,218 INFO [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6., storeName=85653a47b2e3f679e9493cdd405920d6/family2, priority=12, startTime=1698598483994; duration=0sec 2023-10-29 16:54:47,218 DEBUG [RS:0;jenkins-hbase20:43165-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:54:47,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c] to archive 2023-10-29 16:54:47,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:47,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-ffebc3cf1a8149b2828d66ef747cd75d 2023-10-29 16:54:47,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-59ee49e46505455e8f04343be7d3d3b4 2023-10-29 16:54:47,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-34456cfe9f964133a63ddf498182ed5c 2023-10-29 16:54:47,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/family2/testCompactionWithHFileLink=85653a47b2e3f679e9493cdd405920d6-76ec7635f3494eaa8de39d051f401d0c 2023-10-29 16:54:47,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 16:54:47,317 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-29 16:54:47,327 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:47,328 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:47,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:47,333 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:47,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 16:54:47,335 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 16:54:47,335 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:47,336 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 16:54:47,336 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 16:54:47,336 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:47,336 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:47,338 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:47,338 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:47,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:47,338 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:47,338 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:47,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:47,339 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:47,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:47,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:47,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 16:54:47,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 16:54:47,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 16:54:47,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:47,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 16:54:47,340 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:47,340 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. started... 2023-10-29 16:54:47,340 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:47,340 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:47,343 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:47,342 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b761645cf3c2b80fb2a3dad1481d3e2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:47,342 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. started... 2023-10-29 16:54:47,342 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:47,343 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. started... 2023-10-29 16:54:47,343 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a777b792e0007c094a37fa7dd2191d3a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:47,343 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing fee1224f2bb118ba7ba19156a7ef88e1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:54:47,762 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310290f332ce75e9a451f9d316ad690177dfb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310290f332ce75e9a451f9d316ad690177dfb 2023-10-29 16:54:47,762 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298db55c8a549d484f8ca5df73d9cd0c9e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310298db55c8a549d484f8ca5df73d9cd0c9e 2023-10-29 16:54:47,762 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029302077ea63154561b9e0226b369d37ef to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029302077ea63154561b9e0226b369d37ef 2023-10-29 16:54:47,776 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/4544ec91494d433ba67f851913149473 2023-10-29 16:54:47,776 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/86471fd1314445399b2635b9fd80e155 2023-10-29 16:54:47,776 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/45ee4e05011a46ea80f6bde7fa07512f 2023-10-29 16:54:48,200 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029823f4699bac34eaea2b5ed29feff2556 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029823f4699bac34eaea2b5ed29feff2556 2023-10-29 16:54:48,200 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298529ba5840094274b014fddbc0326a93 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310298529ba5840094274b014fddbc0326a93 2023-10-29 16:54:48,200 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295192a8c7d3c94449bd9c8d0d87d5ba45 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310295192a8c7d3c94449bd9c8d0d87d5ba45 2023-10-29 16:54:48,472 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-10-29 16:54:48,607 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/591456605c924cf9b0be958fe0acccfa 2023-10-29 16:54:48,608 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/442be4f8b6f94c97af3aabfdccebba9b 2023-10-29 16:54:48,608 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/857637001575449eb40a091ffb5b8bfb 2023-10-29 16:54:48,616 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/4544ec91494d433ba67f851913149473 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473 2023-10-29 16:54:48,616 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/86471fd1314445399b2635b9fd80e155 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155 2023-10-29 16:54:48,617 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/45ee4e05011a46ea80f6bde7fa07512f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f 2023-10-29 16:54:48,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:48,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:48,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 16:54:48,622 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/442be4f8b6f94c97af3aabfdccebba9b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b 2023-10-29 16:54:48,622 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/857637001575449eb40a091ffb5b8bfb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb 2023-10-29 16:54:48,622 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/591456605c924cf9b0be958fe0acccfa as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa 2023-10-29 16:54:48,626 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:48,626 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:48,627 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for fee1224f2bb118ba7ba19156a7ef88e1 in 1284ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:48,627 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a777b792e0007c094a37fa7dd2191d3a in 1284ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:48,627 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-29 16:54:48,627 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-29 16:54:48,627 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:48,628 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2b761645cf3c2b80fb2a3dad1481d3e2 in 1286ms, sequenceid=5, compaction requested=false 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:48,628 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,628 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 16:54:48,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 16:54:48,629 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,629 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:48,630 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,630 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:48,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:48,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 16:54:48,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@133b84e7[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:48,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 16:54:48,631 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,632 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,632 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 16:54:48,632 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 16:54:48,632 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:48,632 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,632 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:48,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 16:54:48,633 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:48,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 16:54:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:48,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:48,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:48,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 16:54:48,635 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 16:54:48,635 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:48,635 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:48,635 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 16:54:48,635 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:48,636 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,636 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:48,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:48,637 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,638 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:48,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:48,639 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:48,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:48,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:48,639 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,640 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 16:54:48,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:48,640 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:48,640 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:48,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:48,640 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:48,640 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:48,740 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:48,742 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:48,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:48,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:48,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:48,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 16:54:48,747 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 16:54:48,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:48,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 16:54:48,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 16:54:48,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,747 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:48,748 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:48,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:48,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:48,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:48,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:48,749 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:48,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:48,749 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 16:54:48,750 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 16:54:48,750 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 16:54:48,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 16:54:48,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:48,750 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 16:54:48,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:48,750 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. started... 2023-10-29 16:54:48,750 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b761645cf3c2b80fb2a3dad1481d3e2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:48,751 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:48,752 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. started... 2023-10-29 16:54:48,752 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a777b792e0007c094a37fa7dd2191d3a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:48,752 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:48,752 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:48,752 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:48,752 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. started... 2023-10-29 16:54:48,752 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing fee1224f2bb118ba7ba19156a7ef88e1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:54:48,781 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d0b13f13f3e6417cbf86348720380e1a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029d0b13f13f3e6417cbf86348720380e1a 2023-10-29 16:54:49,183 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029eda0946edc094638af8c99f550bb2e70 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029eda0946edc094638af8c99f550bb2e70 2023-10-29 16:54:49,186 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310298d2e6731b062407cb97d718f4980a042 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310298d2e6731b062407cb97d718f4980a042 2023-10-29 16:54:49,187 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/4a6dc45626ef4f6489623d1f2c401e49 2023-10-29 16:54:49,193 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/61df117a5e444c2c8a7375b590f6e873 2023-10-29 16:54:49,202 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310299dcaf39ad6e44ee4b8acb2cf23819b9d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310299dcaf39ad6e44ee4b8acb2cf23819b9d 2023-10-29 16:54:49,592 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/b769be82c9064593917334fe9c31a35f 2023-10-29 16:54:49,612 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293326c0480a6a4928aabd164cd6a36b3d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310293326c0480a6a4928aabd164cd6a36b3d 2023-10-29 16:54:49,613 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/b03a6ae4fa2145c4a5aba566539883d8 2023-10-29 16:54:49,614 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310293aed5b51dbe74aeca88c454cc82b13cb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310293aed5b51dbe74aeca88c454cc82b13cb 2023-10-29 16:54:49,618 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb 2023-10-29 16:54:49,618 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/4a6dc45626ef4f6489623d1f2c401e49 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49 2023-10-29 16:54:49,619 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/9b7b52c4fd1d4b42b798f05616848651 2023-10-29 16:54:49,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:49,621 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/61df117a5e444c2c8a7375b590f6e873 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873 2023-10-29 16:54:49,622 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/b03a6ae4fa2145c4a5aba566539883d8 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8 2023-10-29 16:54:49,622 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/b769be82c9064593917334fe9c31a35f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f 2023-10-29 16:54:49,625 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:49,626 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:49,626 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 16:54:49,626 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb 2023-10-29 16:54:49,626 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2b761645cf3c2b80fb2a3dad1481d3e2 in 876ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:49,626 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:49,626 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:49,627 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:49,627 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/9b7b52c4fd1d4b42b798f05616848651 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651 2023-10-29 16:54:49,631 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:49,632 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:54:49,632 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for fee1224f2bb118ba7ba19156a7ef88e1 in 880ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:49,632 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:49,632 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:49,632 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:49,633 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a777b792e0007c094a37fa7dd2191d3a in 881ms, sequenceid=9, compaction requested=false 2023-10-29 16:54:49,633 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:49,633 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:49,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:49,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:49,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 16:54:49,633 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 16:54:49,635 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,635 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 16:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@337d1f67[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:49,637 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 16:54:49,637 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,637 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 16:54:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 16:54:49,637 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:49,638 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,638 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:49,638 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:49,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 16:54:49,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:49,638 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 16:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:49,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 16:54:49,641 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 16:54:49,641 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:49,641 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:49,641 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 16:54:49,641 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:49,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,642 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:49,643 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:49,644 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:49,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:49,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 16:54:49,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:49,645 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:49,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,645 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:49,646 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,646 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:49,646 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:49,646 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,746 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:49,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:49,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:49,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:49,748 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:49,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:49,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:49,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 16:54:49,754 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 16:54:49,754 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:49,754 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 16:54:49,754 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 16:54:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,755 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:49,757 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:49,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:49,757 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:49,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:49,758 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:49,758 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:49,759 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 16:54:49,759 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 16:54:49,759 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 16:54:49,759 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 16:54:49,759 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:49,759 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 16:54:49,759 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:49,759 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. started... 2023-10-29 16:54:49,760 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:49,760 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:49,760 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:49,760 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:49,760 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. started... 2023-10-29 16:54:49,760 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b761645cf3c2b80fb2a3dad1481d3e2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:49,760 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing fee1224f2bb118ba7ba19156a7ef88e1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:49,760 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. started... 2023-10-29 16:54:49,760 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a777b792e0007c094a37fa7dd2191d3a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:54:49,775 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029646a2e01be35437391e875a5413849df to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029646a2e01be35437391e875a5413849df 2023-10-29 16:54:49,778 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310296e1d5ac4e17a439b8f57f6f518c8b5ca to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310296e1d5ac4e17a439b8f57f6f518c8b5ca 2023-10-29 16:54:49,785 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295fa782f3aec748a5b2d29a3cb7a1b92f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310295fa782f3aec748a5b2d29a3cb7a1b92f 2023-10-29 16:54:49,796 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/d3f278f0395043e186212efc98f31672 2023-10-29 16:54:50,197 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/6770cd77451e4eb3bf47c845c6cd2e3e 2023-10-29 16:54:50,204 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/ada85ea5db784bbc9a5918dd3dc1ef91 2023-10-29 16:54:50,217 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293b0ec3ce42104c6d961652bb4cdb5c86 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310293b0ec3ce42104c6d961652bb4cdb5c86 2023-10-29 16:54:50,223 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/797d5aae7bd9438882ec5fe3ad6695ee 2023-10-29 16:54:50,227 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/d3f278f0395043e186212efc98f31672 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672 2023-10-29 16:54:50,230 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:50,230 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/797d5aae7bd9438882ec5fe3ad6695ee as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee 2023-10-29 16:54:50,234 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:50,234 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for fee1224f2bb118ba7ba19156a7ef88e1 in 474ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:50,234 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:50,234 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:50,234 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:50,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029c2cff2aafe204da19daae444b8521df5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231029c2cff2aafe204da19daae444b8521df5 2023-10-29 16:54:50,628 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102983be71e2ed4048dfbb9ca0fb07f575e0 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023102983be71e2ed4048dfbb9ca0fb07f575e0 2023-10-29 16:54:50,630 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/11dbddc820ee4453ba9a26c7532129fe 2023-10-29 16:54:50,635 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/6770cd77451e4eb3bf47c845c6cd2e3e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e 2023-10-29 16:54:50,640 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:50,641 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/11dbddc820ee4453ba9a26c7532129fe as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe 2023-10-29 16:54:50,646 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:50,646 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2b761645cf3c2b80fb2a3dad1481d3e2 in 886ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:50,647 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:50,647 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:50,647 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:51,035 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/407c34f0f3af4849a1830788a5c1f6f5 2023-10-29 16:54:51,039 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/ada85ea5db784bbc9a5918dd3dc1ef91 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91 2023-10-29 16:54:51,043 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 16:54:51,044 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/407c34f0f3af4849a1830788a5c1f6f5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5 2023-10-29 16:54:51,048 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:54:51,049 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a777b792e0007c094a37fa7dd2191d3a in 1289ms, sequenceid=13, compaction requested=true 2023-10-29 16:54:51,049 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:51,049 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:51,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:51,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:51,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 16:54:51,049 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 16:54:51,050 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,050 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:51,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:51,051 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,051 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:51,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 16:54:51,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b141420[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:51,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 16:54:51,052 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,053 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,053 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 16:54:51,053 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 16:54:51,053 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:51,053 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,053 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:51,054 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 16:54:51,054 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,054 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:51,054 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 16:54:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:51,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:51,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 16:54:51,056 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 16:54:51,056 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:51,056 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:51,056 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 16:54:51,056 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:51,057 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,057 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:51,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:51,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,057 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:51,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:51,058 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:51,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,059 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:51,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:51,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:51,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:51,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 16:54:51,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:51,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:51,061 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:51,161 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:51,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:51,164 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:51,164 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:51,164 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:54:51,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:51,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:51,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 16:54:51,169 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 16:54:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 16:54:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 16:54:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,169 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:51,170 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:51,170 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:51,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:51,171 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:51,171 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:51,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:51,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:51,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 16:54:51,172 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 16:54:51,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 16:54:51,172 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 16:54:51,172 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:51,172 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:51,172 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:51,172 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. started... 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. started... 2023-10-29 16:54:51,172 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. started... 2023-10-29 16:54:51,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a777b792e0007c094a37fa7dd2191d3a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:51,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing fee1224f2bb118ba7ba19156a7ef88e1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:51,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b761645cf3c2b80fb2a3dad1481d3e2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:54:51,189 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310297c2987b93eca4630bb7407967cb1cdb3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310297c2987b93eca4630bb7407967cb1cdb3 2023-10-29 16:54:51,586 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291d042b3d8a234a4584c726bd6869ba2a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310291d042b3d8a234a4584c726bd6869ba2a 2023-10-29 16:54:51,594 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/2a3206d81df047d4b5d45f16cd4de351 2023-10-29 16:54:51,595 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029fb5256c5f2a54c3cae256aed7ece98f1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029fb5256c5f2a54c3cae256aed7ece98f1 2023-10-29 16:54:51,610 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/271ebdc2f1c64118af8d7005848e82cc 2023-10-29 16:54:51,872 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:54:52,011 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/836a60aa84fc4f3f87c326f41959e52e 2023-10-29 16:54:52,033 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102988ea78673d8b43a98a2f3516893bb184 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023102988ea78673d8b43a98a2f3516893bb184 2023-10-29 16:54:52,056 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291573b7cb8f2c41128e1d496288f3e7cb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310291573b7cb8f2c41128e1d496288f3e7cb 2023-10-29 16:54:52,437 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102982f5daf6acbc466393507627a991e742 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023102982f5daf6acbc466393507627a991e742 2023-10-29 16:54:52,454 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/0dc34207d78242ea90770cc2753515d2 2023-10-29 16:54:52,462 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/2a3206d81df047d4b5d45f16cd4de351 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351 2023-10-29 16:54:52,466 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:52,466 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/c36985160bdd43c9ba2a42491fea362c 2023-10-29 16:54:52,468 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/0dc34207d78242ea90770cc2753515d2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2 2023-10-29 16:54:52,472 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/271ebdc2f1c64118af8d7005848e82cc as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc 2023-10-29 16:54:52,473 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:52,474 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for fee1224f2bb118ba7ba19156a7ef88e1 in 1301ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:52,474 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:52,474 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:52,474 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:52,475 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:52,476 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/c36985160bdd43c9ba2a42491fea362c as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c 2023-10-29 16:54:52,481 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:52,483 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2b761645cf3c2b80fb2a3dad1481d3e2 in 1310ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:52,483 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:52,483 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:52,483 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:52,845 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/0b16a58f92d74ea7bccf24c0374035eb 2023-10-29 16:54:52,852 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/836a60aa84fc4f3f87c326f41959e52e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e 2023-10-29 16:54:52,855 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 16:54:52,856 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/0b16a58f92d74ea7bccf24c0374035eb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb 2023-10-29 16:54:52,859 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:54:52,862 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a777b792e0007c094a37fa7dd2191d3a in 1689ms, sequenceid=17, compaction requested=true 2023-10-29 16:54:52,862 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:52,862 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:52,862 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:52,862 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:52,862 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,862 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 16:54:52,862 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 16:54:52,868 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,868 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:52,868 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,868 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:52,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:52,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:52,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:52,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 16:54:52,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@450dafbd[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:52,870 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 16:54:52,870 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,871 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 16:54:52,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 16:54:52,871 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,871 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:52,871 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:52,872 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 16:54:52,872 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:52,872 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,872 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 16:54:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:52,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:52,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:52,876 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 16:54:52,876 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 16:54:52,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:52,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:52,876 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 16:54:52,876 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:52,881 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,881 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:52,881 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:52,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:52,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:52,882 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:52,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,883 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:52,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:52,889 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:52,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 16:54:52,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:52,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-29 16:54:52,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:52,889 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:52,890 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:52,890 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:52,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:52,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:52,890 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:52,890 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:52,990 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:52,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:53,006 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:53,017 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:53,039 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:53,040 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:53,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:54:53,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 16:54:53,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 16:54:53,096 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 16:54:53,096 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:53,096 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 16:54:53,096 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 16:54:53,097 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:53,097 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:53,098 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:53,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:53,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:53,099 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:53,099 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:53,099 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 16:54:53,099 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 16:54:53,099 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 16:54:53,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 16:54:53,100 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:54:53,100 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 16:54:53,100 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:53,100 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. started... 2023-10-29 16:54:53,100 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 2b761645cf3c2b80fb2a3dad1481d3e2 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:53,102 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:53,102 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:54:53,102 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:54:53,102 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:53,102 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. started... 2023-10-29 16:54:53,102 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. started... 2023-10-29 16:54:53,103 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a777b792e0007c094a37fa7dd2191d3a 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:53,103 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing fee1224f2bb118ba7ba19156a7ef88e1 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:54:53,526 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/f1b53e5d363b42acb24a3d772ac87727 2023-10-29 16:54:53,531 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1b53e5d363b42acb24a3d772ac87727 2023-10-29 16:54:53,544 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/87cb6176a7b047d8b2ce308daf04f175 2023-10-29 16:54:53,547 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87cb6176a7b047d8b2ce308daf04f175 2023-10-29 16:54:53,550 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/549dbd7efbd1410da107c66a5daa3cd4 2023-10-29 16:54:53,553 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 549dbd7efbd1410da107c66a5daa3cd4 2023-10-29 16:54:53,554 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/f1b53e5d363b42acb24a3d772ac87727 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727 2023-10-29 16:54:53,560 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1b53e5d363b42acb24a3d772ac87727 2023-10-29 16:54:53,560 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:53,561 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/549dbd7efbd1410da107c66a5daa3cd4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4 2023-10-29 16:54:53,574 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 549dbd7efbd1410da107c66a5daa3cd4 2023-10-29 16:54:53,574 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:53,574 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a777b792e0007c094a37fa7dd2191d3a in 472ms, sequenceid=23, compaction requested=true 2023-10-29 16:54:53,575 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:53,575 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:53,575 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:54:53,921 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/6508f54d3e524bdf934f8a7d28eb6647 2023-10-29 16:54:53,925 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6508f54d3e524bdf934f8a7d28eb6647 2023-10-29 16:54:53,948 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:53,948 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b8824cf to 127.0.0.1:61373 2023-10-29 16:54:53,948 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:53,948 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:54:53,948 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x780d95e7 to 127.0.0.1:61373 2023-10-29 16:54:53,948 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:54:53,973 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/0017860d409a40f8a31b1fc0c9539593 2023-10-29 16:54:53,976 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0017860d409a40f8a31b1fc0c9539593 2023-10-29 16:54:53,977 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/87cb6176a7b047d8b2ce308daf04f175 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175 2023-10-29 16:54:53,980 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87cb6176a7b047d8b2ce308daf04f175 2023-10-29 16:54:53,980 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:53,981 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/0017860d409a40f8a31b1fc0c9539593 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593 2023-10-29 16:54:53,987 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0017860d409a40f8a31b1fc0c9539593 2023-10-29 16:54:53,987 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:53,988 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for fee1224f2bb118ba7ba19156a7ef88e1 in 885ms, sequenceid=23, compaction requested=true 2023-10-29 16:54:53,988 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:53,988 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:53,988 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:54:54,360 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/95172db4164e444bb59de6e4e10a475e 2023-10-29 16:54:54,367 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95172db4164e444bb59de6e4e10a475e 2023-10-29 16:54:54,368 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/6508f54d3e524bdf934f8a7d28eb6647 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647 2023-10-29 16:54:54,371 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6508f54d3e524bdf934f8a7d28eb6647 2023-10-29 16:54:54,372 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:54,372 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/95172db4164e444bb59de6e4e10a475e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e 2023-10-29 16:54:54,377 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 95172db4164e444bb59de6e4e10a475e 2023-10-29 16:54:54,378 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:54:54,378 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2b761645cf3c2b80fb2a3dad1481d3e2 in 1278ms, sequenceid=23, compaction requested=true 2023-10-29 16:54:54,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:54,378 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:54,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:54:54,378 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:54:54,379 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,379 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 16:54:54,379 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 16:54:54,380 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,380 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:54,380 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,380 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 16:54:54,381 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a4d0c48[Count = 0] remaining members to acquire global barrier 2023-10-29 16:54:54,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 16:54:54,381 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,383 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,383 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 16:54:54,383 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 16:54:54,383 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:54:54,383 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,383 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:54:54,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 16:54:54,384 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,384 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 16:54:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:54,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:54,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:54:54,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 16:54:54,386 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 16:54:54,386 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:54:54,386 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:54:54,386 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 16:54:54,386 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:54:54,387 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,387 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:54:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:54:54,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,387 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:54:54,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:54,388 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:54:54,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,389 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:54:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 16:54:54,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:54:54,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,390 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 16:54:54,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 16:54:54,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:54:54,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:54:54,390 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 16:54:54,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:54:54,391 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 16:54:54,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:54:54,391 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:54:54,492 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:54:54,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:54:54,493 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:54,493 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 2b761645cf3c2b80fb2a3dad1481d3e2/family1 is initiating major compaction (all files) 2023-10-29 16:54:54,493 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:54,493 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:54,494 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 2b761645cf3c2b80fb2a3dad1481d3e2/family1 in ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:54,494 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp, totalSize=26.6 K 2023-10-29 16:54:54,495 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4544ec91494d433ba67f851913149473, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487327 2023-10-29 16:54:54,495 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4a6dc45626ef4f6489623d1f2c401e49, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488742 2023-10-29 16:54:54,496 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6770cd77451e4eb3bf47c845c6cd2e3e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:54,496 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 271ebdc2f1c64118af8d7005848e82cc, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:54,496 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6508f54d3e524bdf934f8a7d28eb6647, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:54,510 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 2b761645cf3c2b80fb2a3dad1481d3e2#family1#compaction#149 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:54,522 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029352e368b730d428aa399a457c3ba36a6_del 2023-10-29 16:54:54,522 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029352e368b730d428aa399a457c3ba36a6_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029352e368b730d428aa399a457c3ba36a6_del 2023-10-29 16:54:55,337 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae6bfb8821e74427915780eab0d32f57 2023-10-29 16:54:55,338 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family1/ae6bfb8821e74427915780eab0d32f57 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/ae6bfb8821e74427915780eab0d32f57 2023-10-29 16:54:55,342 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ae6bfb8821e74427915780eab0d32f57 2023-10-29 16:54:55,343 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b761645cf3c2b80fb2a3dad1481d3e2/family1 of 2b761645cf3c2b80fb2a3dad1481d3e2 into ae6bfb8821e74427915780eab0d32f57(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:55,343 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:55,343 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:55,343 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 2b761645cf3c2b80fb2a3dad1481d3e2/family2 is initiating major compaction (all files) 2023-10-29 16:54:55,344 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:55,344 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:55,344 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 2b761645cf3c2b80fb2a3dad1481d3e2/family2 in ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:54:55,344 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp, totalSize=25.3 K 2023-10-29 16:54:55,344 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 442be4f8b6f94c97af3aabfdccebba9b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487327 2023-10-29 16:54:55,345 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b03a6ae4fa2145c4a5aba566539883d8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488742 2023-10-29 16:54:55,345 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 11dbddc820ee4453ba9a26c7532129fe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:55,345 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting c36985160bdd43c9ba2a42491fea362c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:55,346 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 95172db4164e444bb59de6e4e10a475e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:55,363 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 2b761645cf3c2b80fb2a3dad1481d3e2#family2#compaction#150 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:55,377 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310290b20a5b5fa5844718c0a2b942245dff2_del 2023-10-29 16:54:55,377 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310290b20a5b5fa5844718c0a2b942245dff2_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310290b20a5b5fa5844718c0a2b942245dff2_del 2023-10-29 16:54:55,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647] to archive 2023-10-29 16:54:55,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:55,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4544ec91494d433ba67f851913149473 2023-10-29 16:54:55,387 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/4a6dc45626ef4f6489623d1f2c401e49 2023-10-29 16:54:55,392 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6770cd77451e4eb3bf47c845c6cd2e3e 2023-10-29 16:54:55,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/271ebdc2f1c64118af8d7005848e82cc 2023-10-29 16:54:55,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/6508f54d3e524bdf934f8a7d28eb6647 2023-10-29 16:54:56,193 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c288b69c2f9e48e79e3c13cc3b058d2b 2023-10-29 16:54:56,194 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/.tmp/family2/c288b69c2f9e48e79e3c13cc3b058d2b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c288b69c2f9e48e79e3c13cc3b058d2b 2023-10-29 16:54:56,197 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c288b69c2f9e48e79e3c13cc3b058d2b 2023-10-29 16:54:56,198 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b761645cf3c2b80fb2a3dad1481d3e2/family2 of 2b761645cf3c2b80fb2a3dad1481d3e2 into c288b69c2f9e48e79e3c13cc3b058d2b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:56,198 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:54:56,199 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:56,199 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): a777b792e0007c094a37fa7dd2191d3a/family1 is initiating major compaction (all files) 2023-10-29 16:54:56,199 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:56,199 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:56,199 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of a777b792e0007c094a37fa7dd2191d3a/family1 in ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:56,200 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp, totalSize=26.6 K 2023-10-29 16:54:56,200 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 86471fd1314445399b2635b9fd80e155, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487329 2023-10-29 16:54:56,200 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b769be82c9064593917334fe9c31a35f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488743 2023-10-29 16:54:56,201 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ada85ea5db784bbc9a5918dd3dc1ef91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:56,201 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 836a60aa84fc4f3f87c326f41959e52e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:56,201 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting f1b53e5d363b42acb24a3d772ac87727, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:56,219 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): a777b792e0007c094a37fa7dd2191d3a#family1#compaction#151 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:56,284 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e] to archive 2023-10-29 16:54:56,285 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:56,287 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/442be4f8b6f94c97af3aabfdccebba9b 2023-10-29 16:54:56,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/b03a6ae4fa2145c4a5aba566539883d8 2023-10-29 16:54:56,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/11dbddc820ee4453ba9a26c7532129fe 2023-10-29 16:54:56,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/c36985160bdd43c9ba2a42491fea362c 2023-10-29 16:54:56,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family2/95172db4164e444bb59de6e4e10a475e 2023-10-29 16:54:56,629 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102977ecb122f47f45a68f70d2029d5eb180_del 2023-10-29 16:54:56,630 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102977ecb122f47f45a68f70d2029d5eb180_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102977ecb122f47f45a68f70d2029d5eb180_del 2023-10-29 16:54:57,450 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4e8e50d383942b0a8524eb883e9bbcd 2023-10-29 16:54:57,451 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family1/c4e8e50d383942b0a8524eb883e9bbcd as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/c4e8e50d383942b0a8524eb883e9bbcd 2023-10-29 16:54:57,455 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4e8e50d383942b0a8524eb883e9bbcd 2023-10-29 16:54:57,456 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a777b792e0007c094a37fa7dd2191d3a/family1 of a777b792e0007c094a37fa7dd2191d3a into c4e8e50d383942b0a8524eb883e9bbcd(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:54:57,456 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:57,456 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:57,456 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): a777b792e0007c094a37fa7dd2191d3a/family2 is initiating major compaction (all files) 2023-10-29 16:54:57,456 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:57,456 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:57,457 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of a777b792e0007c094a37fa7dd2191d3a/family2 in ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:54:57,457 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp, totalSize=25.3 K 2023-10-29 16:54:57,457 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 591456605c924cf9b0be958fe0acccfa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487329 2023-10-29 16:54:57,458 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 9b7b52c4fd1d4b42b798f05616848651, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488743 2023-10-29 16:54:57,458 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 407c34f0f3af4849a1830788a5c1f6f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:57,458 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0b16a58f92d74ea7bccf24c0374035eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:57,462 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 549dbd7efbd1410da107c66a5daa3cd4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:57,476 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): a777b792e0007c094a37fa7dd2191d3a#family2#compaction#152 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:57,482 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727] to archive 2023-10-29 16:54:57,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:57,485 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/86471fd1314445399b2635b9fd80e155 2023-10-29 16:54:57,486 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/b769be82c9064593917334fe9c31a35f 2023-10-29 16:54:57,487 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/ada85ea5db784bbc9a5918dd3dc1ef91 2023-10-29 16:54:57,488 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/836a60aa84fc4f3f87c326f41959e52e 2023-10-29 16:54:57,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/f1b53e5d363b42acb24a3d772ac87727 2023-10-29 16:54:57,888 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310291dd5a5b3618a4b858cc99afaacbcbd8b_del 2023-10-29 16:54:57,889 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291dd5a5b3618a4b858cc99afaacbcbd8b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310291dd5a5b3618a4b858cc99afaacbcbd8b_del 2023-10-29 16:54:58,306 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8e9b08e74b1451fba17d470a425f745 2023-10-29 16:54:58,309 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/.tmp/family2/a8e9b08e74b1451fba17d470a425f745 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/a8e9b08e74b1451fba17d470a425f745 2023-10-29 16:54:58,317 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8e9b08e74b1451fba17d470a425f745 2023-10-29 16:54:58,318 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a777b792e0007c094a37fa7dd2191d3a/family2 of a777b792e0007c094a37fa7dd2191d3a into a8e9b08e74b1451fba17d470a425f745(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:58,318 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:54:58,318 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:58,319 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): fee1224f2bb118ba7ba19156a7ef88e1/family1 is initiating major compaction (all files) 2023-10-29 16:54:58,319 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:58,319 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:58,320 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of fee1224f2bb118ba7ba19156a7ef88e1/family1 in ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:58,320 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp, totalSize=26.6 K 2023-10-29 16:54:58,320 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 45ee4e05011a46ea80f6bde7fa07512f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487328 2023-10-29 16:54:58,320 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 61df117a5e444c2c8a7375b590f6e873, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488743 2023-10-29 16:54:58,321 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting d3f278f0395043e186212efc98f31672, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:58,321 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 2a3206d81df047d4b5d45f16cd4de351, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:58,321 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 87cb6176a7b047d8b2ce308daf04f175, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:58,329 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): fee1224f2bb118ba7ba19156a7ef88e1#family1#compaction#153 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:58,346 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310291783fd426ffa41cbaebec6b6b2900abf_del 2023-10-29 16:54:58,347 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310291783fd426ffa41cbaebec6b6b2900abf_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310291783fd426ffa41cbaebec6b6b2900abf_del 2023-10-29 16:54:58,383 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4] to archive 2023-10-29 16:54:58,384 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:58,386 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/591456605c924cf9b0be958fe0acccfa 2023-10-29 16:54:58,388 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/9b7b52c4fd1d4b42b798f05616848651 2023-10-29 16:54:58,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/407c34f0f3af4849a1830788a5c1f6f5 2023-10-29 16:54:58,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/0b16a58f92d74ea7bccf24c0374035eb 2023-10-29 16:54:58,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family2/549dbd7efbd1410da107c66a5daa3cd4 2023-10-29 16:54:58,771 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9859b786f37f4bdbaeb4af2b7c3fc74a 2023-10-29 16:54:58,772 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family1/9859b786f37f4bdbaeb4af2b7c3fc74a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/9859b786f37f4bdbaeb4af2b7c3fc74a 2023-10-29 16:54:58,775 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9859b786f37f4bdbaeb4af2b7c3fc74a 2023-10-29 16:54:58,776 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fee1224f2bb118ba7ba19156a7ef88e1/family1 of fee1224f2bb118ba7ba19156a7ef88e1 into 9859b786f37f4bdbaeb4af2b7c3fc74a(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:58,776 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:58,776 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:54:58,776 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): fee1224f2bb118ba7ba19156a7ef88e1/family2 is initiating major compaction (all files) 2023-10-29 16:54:58,776 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:54:58,776 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:54:58,778 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of fee1224f2bb118ba7ba19156a7ef88e1/family2 in ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:54:58,778 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp, totalSize=25.3 K 2023-10-29 16:54:58,779 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 857637001575449eb40a091ffb5b8bfb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598487328 2023-10-29 16:54:58,779 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4a45b0625f8e4958a9ce2dc3c12ccdeb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598488743 2023-10-29 16:54:58,779 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 797d5aae7bd9438882ec5fe3ad6695ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598489748 2023-10-29 16:54:58,780 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0dc34207d78242ea90770cc2753515d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598491164 2023-10-29 16:54:58,780 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0017860d409a40f8a31b1fc0c9539593, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:54:58,782 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175] to archive 2023-10-29 16:54:58,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:58,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/45ee4e05011a46ea80f6bde7fa07512f 2023-10-29 16:54:58,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/61df117a5e444c2c8a7375b590f6e873 2023-10-29 16:54:58,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/d3f278f0395043e186212efc98f31672 2023-10-29 16:54:58,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/2a3206d81df047d4b5d45f16cd4de351 2023-10-29 16:54:58,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/87cb6176a7b047d8b2ce308daf04f175 2023-10-29 16:54:58,801 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): fee1224f2bb118ba7ba19156a7ef88e1#family2#compaction#154 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:54:59,220 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029133ec29f5f77489cb262edcb3ecdf1a6_del 2023-10-29 16:54:59,220 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029133ec29f5f77489cb262edcb3ecdf1a6_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029133ec29f5f77489cb262edcb3ecdf1a6_del 2023-10-29 16:54:59,646 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f873f47d49114684af929fb5c39a0f5d 2023-10-29 16:54:59,648 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/.tmp/family2/f873f47d49114684af929fb5c39a0f5d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/f873f47d49114684af929fb5c39a0f5d 2023-10-29 16:54:59,655 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f873f47d49114684af929fb5c39a0f5d 2023-10-29 16:54:59,656 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in fee1224f2bb118ba7ba19156a7ef88e1/family2 of fee1224f2bb118ba7ba19156a7ef88e1 into f873f47d49114684af929fb5c39a0f5d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:54:59,656 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:54:59,659 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:59,662 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:59,666 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:54:59,667 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:54:59,671 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:54:59,685 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-29 16:54:59,687 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029352e368b730d428aa399a457c3ba36a6_del 2023-10-29 16:54:59,690 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310291783fd426ffa41cbaebec6b6b2900abf_del 2023-10-29 16:54:59,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593] to archive 2023-10-29 16:54:59,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:54:59,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/857637001575449eb40a091ffb5b8bfb 2023-10-29 16:54:59,693 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102977ecb122f47f45a68f70d2029d5eb180_del 2023-10-29 16:54:59,693 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-29 16:54:59,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/4a45b0625f8e4958a9ce2dc3c12ccdeb 2023-10-29 16:54:59,694 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(139): Connect 0x79f578e0 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:54:59,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/797d5aae7bd9438882ec5fe3ad6695ee 2023-10-29 16:54:59,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0dc34207d78242ea90770cc2753515d2 2023-10-29 16:54:59,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family2/0017860d409a40f8a31b1fc0c9539593 2023-10-29 16:54:59,698 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@390ff17f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:54:59,699 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:54:59,699 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:54:59,699 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:55:00,119 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102989ce2dee11ee4905bbfe2d6b5016a980 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102989ce2dee11ee4905bbfe2d6b5016a980 2023-10-29 16:55:00,120 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310290b633fbd1bde4fe7a2ee9250e57b34aa to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310290b633fbd1bde4fe7a2ee9250e57b34aa 2023-10-29 16:55:00,121 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,121 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,133 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:55:00,136 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:55:00,141 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:55:00,144 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35604, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:55:00,161 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e138448168d4ce6bb9518ec761e42f9 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-29 16:55:00,161 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/39143c3c8f964d129069e837c8cd4433 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-29 16:55:00,161 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e138448168d4ce6bb9518ec761e42f9}] 2023-10-29 16:55:00,162 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/39143c3c8f964d129069e837c8cd4433}] 2023-10-29 16:55:00,167 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/39143c3c8f964d129069e837c8cd4433 for inclusion in 2b761645cf3c2b80fb2a3dad1481d3e2/family1 2023-10-29 16:55:00,168 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e138448168d4ce6bb9518ec761e42f9 for inclusion in a777b792e0007c094a37fa7dd2191d3a/family1 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:55:00,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:55:00,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1e138448168d4ce6bb9518ec761e42f9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__abgpj28cdqgb4ljf2unqu5lp80imh5gfm3ith2daujv2i4lrfvt38do9m1r6lgob/family1/1e138448168d4ce6bb9518ec761e42f9 2023-10-29 16:55:00,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/39143c3c8f964d129069e837c8cd4433 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__askbojq5avhim9d56b6nhsem3npagi3h5csrno8i64u7p8m1bc3hi9ncgsi1e3ai/family1/39143c3c8f964d129069e837c8cd4433 2023-10-29 16:55:00,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__abgpj28cdqgb4ljf2unqu5lp80imh5gfm3ith2daujv2i4lrfvt38do9m1r6lgob/family1/1e138448168d4ce6bb9518ec761e42f9 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/58d394c7c7914e488b4dbec523093631_SeqId_28_ 2023-10-29 16:55:00,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__askbojq5avhim9d56b6nhsem3npagi3h5csrno8i64u7p8m1bc3hi9ncgsi1e3ai/family1/39143c3c8f964d129069e837c8cd4433 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/ca0839adf2c047a7adef22fe63716639_SeqId_28_ 2023-10-29 16:55:00,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__abgpj28cdqgb4ljf2unqu5lp80imh5gfm3ith2daujv2i4lrfvt38do9m1r6lgob/family1/1e138448168d4ce6bb9518ec761e42f9 into a777b792e0007c094a37fa7dd2191d3a/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/58d394c7c7914e488b4dbec523093631_SeqId_28_ - updating store file list. 2023-10-29 16:55:00,173 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__askbojq5avhim9d56b6nhsem3npagi3h5csrno8i64u7p8m1bc3hi9ncgsi1e3ai/family1/39143c3c8f964d129069e837c8cd4433 into 2b761645cf3c2b80fb2a3dad1481d3e2/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/ca0839adf2c047a7adef22fe63716639_SeqId_28_ - updating store file list. 2023-10-29 16:55:00,176 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/ca0839adf2c047a7adef22fe63716639_SeqId_28_ into 2b761645cf3c2b80fb2a3dad1481d3e2/family1 2023-10-29 16:55:00,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/58d394c7c7914e488b4dbec523093631_SeqId_28_ into a777b792e0007c094a37fa7dd2191d3a/family1 2023-10-29 16:55:00,176 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__askbojq5avhim9d56b6nhsem3npagi3h5csrno8i64u7p8m1bc3hi9ncgsi1e3ai/family1/39143c3c8f964d129069e837c8cd4433 into 2b761645cf3c2b80fb2a3dad1481d3e2/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/family1/ca0839adf2c047a7adef22fe63716639_SeqId_28_) 2023-10-29 16:55:00,176 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__abgpj28cdqgb4ljf2unqu5lp80imh5gfm3ith2daujv2i4lrfvt38do9m1r6lgob/family1/1e138448168d4ce6bb9518ec761e42f9 into a777b792e0007c094a37fa7dd2191d3a/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/family1/58d394c7c7914e488b4dbec523093631_SeqId_28_) 2023-10-29 16:55:00,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__abgpj28cdqgb4ljf2unqu5lp80imh5gfm3ith2daujv2i4lrfvt38do9m1r6lgob/family1/1e138448168d4ce6bb9518ec761e42f9 2023-10-29 16:55:00,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__askbojq5avhim9d56b6nhsem3npagi3h5csrno8i64u7p8m1bc3hi9ncgsi1e3ai/family1/39143c3c8f964d129069e837c8cd4433 2023-10-29 16:55:00,178 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,178 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,179 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:00,179 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:00,180 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029302077ea63154561b9e0226b369d37ef to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029302077ea63154561b9e0226b369d37ef 2023-10-29 16:55:00,180 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 16:55:00,180 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 16:55:00,180 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310298db55c8a549d484f8ca5df73d9cd0c9e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310298db55c8a549d484f8ca5df73d9cd0c9e 2023-10-29 16:55:00,180 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 16:55:00,180 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 16:55:00,180 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:55:00,181 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:55:00,521 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029d93f98f93ce34203870cf540653ac479 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029d93f98f93ce34203870cf540653ac479 2023-10-29 16:55:00,523 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,550 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c6f4ef81c20b4b58a49e0e95998fa508 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-29 16:55:00,551 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c6f4ef81c20b4b58a49e0e95998fa508}] 2023-10-29 16:55:00,553 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c6f4ef81c20b4b58a49e0e95998fa508 for inclusion in fee1224f2bb118ba7ba19156a7ef88e1/family1 2023-10-29 16:55:00,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-29 16:55:00,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 16:55:00,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:55:00,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/c6f4ef81c20b4b58a49e0e95998fa508 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__s7ligcjgi17jajo6l9bmneutmrkfoji0mi7jud4blo4lafm09g772om0p8itiijd/family1/c6f4ef81c20b4b58a49e0e95998fa508 2023-10-29 16:55:00,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__s7ligcjgi17jajo6l9bmneutmrkfoji0mi7jud4blo4lafm09g772om0p8itiijd/family1/c6f4ef81c20b4b58a49e0e95998fa508 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/b9217cabc6cd4c029b03b178c3ea07a8_SeqId_28_ 2023-10-29 16:55:00,558 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__s7ligcjgi17jajo6l9bmneutmrkfoji0mi7jud4blo4lafm09g772om0p8itiijd/family1/c6f4ef81c20b4b58a49e0e95998fa508 into fee1224f2bb118ba7ba19156a7ef88e1/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/b9217cabc6cd4c029b03b178c3ea07a8_SeqId_28_ - updating store file list. 2023-10-29 16:55:00,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/b9217cabc6cd4c029b03b178c3ea07a8_SeqId_28_ into fee1224f2bb118ba7ba19156a7ef88e1/family1 2023-10-29 16:55:00,561 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__s7ligcjgi17jajo6l9bmneutmrkfoji0mi7jud4blo4lafm09g772om0p8itiijd/family1/c6f4ef81c20b4b58a49e0e95998fa508 into fee1224f2bb118ba7ba19156a7ef88e1/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/family1/b9217cabc6cd4c029b03b178c3ea07a8_SeqId_28_) 2023-10-29 16:55:00,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__ns_testMinorCompaction__s7ligcjgi17jajo6l9bmneutmrkfoji0mi7jud4blo4lafm09g772om0p8itiijd/family1/c6f4ef81c20b4b58a49e0e95998fa508 2023-10-29 16:55:00,563 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,563 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:00,564 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310290f332ce75e9a451f9d316ad690177dfb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310290f332ce75e9a451f9d316ad690177dfb 2023-10-29 16:55:00,564 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 16:55:00,564 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 16:55:00,565 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 16:55:00,565 INFO [Listener at localhost/45209] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-29 16:55:00,567 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:00,568 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:00,571 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:00,572 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:00,590 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 287), OpenFileDescriptor=635 (was 770), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 126) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=2623 (was 2648) 2023-10-29 16:55:00,601 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=635, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=2623 2023-10-29 16:55:00,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 16:55:00,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:00,604 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:55:00,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-29 16:55:00,605 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:55:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 16:55:00,606 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:00,606 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6 empty. 2023-10-29 16:55:00,607 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:00,607 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-29 16:55:00,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 16:55:00,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 16:55:01,016 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 16:55:01,020 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 92187c452d6486655f87bc0d417de8a6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 92187c452d6486655f87bc0d417de8a6, disabling compactions & flushes 2023-10-29 16:55:01,031 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. after waiting 0 ms 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,031 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,031 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:01,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:55:01,037 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598501037"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598501037"}]},"ts":"1698598501037"} 2023-10-29 16:55:01,038 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 16:55:01,039 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:55:01,039 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598501039"}]},"ts":"1698598501039"} 2023-10-29 16:55:01,040 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 16:55:01,042 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=92187c452d6486655f87bc0d417de8a6, ASSIGN}] 2023-10-29 16:55:01,043 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=92187c452d6486655f87bc0d417de8a6, ASSIGN 2023-10-29 16:55:01,044 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=92187c452d6486655f87bc0d417de8a6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:55:01,196 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=92187c452d6486655f87bc0d417de8a6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:01,196 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598501195"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598501195"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598501195"}]},"ts":"1698598501195"} 2023-10-29 16:55:01,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 92187c452d6486655f87bc0d417de8a6, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:55:01,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 16:55:01,353 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:01,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92187c452d6486655f87bc0d417de8a6, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.', STARTKEY => '', ENDKEY => ''} 2023-10-29 16:55:01,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:01,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,364 INFO [StoreOpener-92187c452d6486655f87bc0d417de8a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,366 DEBUG [StoreOpener-92187c452d6486655f87bc0d417de8a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:01,366 DEBUG [StoreOpener-92187c452d6486655f87bc0d417de8a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:01,367 INFO [StoreOpener-92187c452d6486655f87bc0d417de8a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92187c452d6486655f87bc0d417de8a6 columnFamilyName family1 2023-10-29 16:55:01,369 INFO [StoreOpener-92187c452d6486655f87bc0d417de8a6-1] regionserver.HStore(310): Store=92187c452d6486655f87bc0d417de8a6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:01,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:01,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:55:01,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 92187c452d6486655f87bc0d417de8a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72838612, jitterRate=0.08537989854812622}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 16:55:01,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:01,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., pid=114, masterSystemTime=1698598501353 2023-10-29 16:55:01,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,381 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=92187c452d6486655f87bc0d417de8a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:01,381 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698598501380"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598501380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598501380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598501380"}]},"ts":"1698598501380"} 2023-10-29 16:55:01,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-29 16:55:01,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 92187c452d6486655f87bc0d417de8a6, server=jenkins-hbase20.apache.org,43165,1698598366173 in 183 msec 2023-10-29 16:55:01,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-29 16:55:01,385 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=92187c452d6486655f87bc0d417de8a6, ASSIGN in 342 msec 2023-10-29 16:55:01,386 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:55:01,386 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598501386"}]},"ts":"1698598501386"} 2023-10-29 16:55:01,387 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 16:55:01,390 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:55:01,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 787 msec 2023-10-29 16:55:01,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 16:55:01,715 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-29 16:55:01,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:01,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,744 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,745 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:01,745 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:01,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:01,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:01,746 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:01,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:01,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:01,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:01,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:01,747 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:01,747 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:01,747 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:01,748 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 16:55:02,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113057c1455a08d546a8b41fcb0d7825019b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113057c1455a08d546a8b41fcb0d7825019b 2023-10-29 16:55:02,178 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/ff7eb68c23a84d268eca9ad4270dc3bc 2023-10-29 16:55:02,185 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/ff7eb68c23a84d268eca9ad4270dc3bc as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc 2023-10-29 16:55:02,192 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 16:55:02,194 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 445ms, sequenceid=5, compaction requested=false 2023-10-29 16:55:02,194 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:02,194 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:02,194 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:02,194 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:02,194 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:02,194 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,195 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:02,195 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:02,196 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:02,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:02,196 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,196 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:02,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:02,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:02,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2153efb[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:02,198 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:02,198 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,199 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:02,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:02,199 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:02,199 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,199 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:02,200 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:02,200 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:02,200 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:02,200 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:02,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:02,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:02,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:02,203 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:02,203 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:02,203 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:02,203 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,203 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:02,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:02,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:02,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,205 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:02,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,206 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:02,208 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:02,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:02,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:02,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:02,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:02,209 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:02,209 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:02,208 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:02,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:02,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,209 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,309 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:02,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:02,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:02,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:02,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,324 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:02,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:02,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:02,324 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:02,325 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,325 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,326 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:02,326 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:02,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:02,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:02,327 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:02,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:02,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,329 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,329 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:02,329 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:02,329 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:02,330 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:02,330 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:02,330 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:02,330 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:02,330 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 16:55:02,755 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bffaf086df7449db9cb44e1e3955c7d4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bffaf086df7449db9cb44e1e3955c7d4 2023-10-29 16:55:03,164 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/0930c250b52b45afbd669188fcdcc4cb 2023-10-29 16:55:03,177 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/0930c250b52b45afbd669188fcdcc4cb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb 2023-10-29 16:55:03,183 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 16:55:03,184 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 854ms, sequenceid=9, compaction requested=false 2023-10-29 16:55:03,184 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:03,184 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:03,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:03,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:03,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:03,184 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:03,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,186 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:03,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:03,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:03,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:03,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:03,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:03,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@788b65c1[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:03,189 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:03,189 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,190 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:03,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:03,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:03,190 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,190 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:03,191 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:03,191 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,191 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:03,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:03,191 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:03,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:03,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:03,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:03,196 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:03,196 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:03,196 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:03,196 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,196 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:03,197 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,197 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,197 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:03,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:03,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:03,198 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:03,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:03,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:03,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:03,204 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:03,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:03,205 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:03,205 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:03,204 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,205 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,205 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,205 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:03,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:03,305 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:03,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:03,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:03,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:03,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,319 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:03,319 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:03,319 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:03,319 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:03,320 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,320 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,321 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:03,321 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:03,321 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:03,322 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,323 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,323 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:03,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:03,323 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:03,324 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:03,324 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:03,324 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:03,324 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:03,324 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:03,324 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:03,324 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:03,741 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016773139966d748cf8932e35d21163e91 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016773139966d748cf8932e35d21163e91 2023-10-29 16:55:04,146 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/492c076a8f3c48eea2485f021403bc20 2023-10-29 16:55:04,150 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/492c076a8f3c48eea2485f021403bc20 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20 2023-10-29 16:55:04,153 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 16:55:04,154 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 830ms, sequenceid=13, compaction requested=true 2023-10-29 16:55:04,154 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:04,154 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:04,154 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:04,154 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:04,154 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,154 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:04,154 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:04,155 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:04,156 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,156 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:04,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:04,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@347e045b[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:04,157 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:04,157 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,157 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:04,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:04,157 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:04,157 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,157 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:04,158 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:04,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:04,158 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:04,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:04,160 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:04,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:04,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:04,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,160 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:04,161 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,161 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,161 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:04,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,161 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,162 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:04,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:04,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:04,163 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,163 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:04,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:04,164 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,164 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:04,164 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,164 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:04,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:04,164 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:04,264 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:04,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:04,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:04,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:04,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,269 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:04,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:04,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:04,269 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:04,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,270 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,270 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:04,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:04,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:04,271 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:04,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,271 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:04,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,272 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,272 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:04,272 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:04,272 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:04,272 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:04,272 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:04,272 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:04,272 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:04,272 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:04,273 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:04,273 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:04,683 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058ff57d32d4f74446ab854f0ac2fd2f6b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058ff57d32d4f74446ab854f0ac2fd2f6b 2023-10-29 16:55:05,087 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/d4c301607dee40d9818c83ce61873efc 2023-10-29 16:55:05,091 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/d4c301607dee40d9818c83ce61873efc as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc 2023-10-29 16:55:05,094 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 16:55:05,095 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 822ms, sequenceid=17, compaction requested=true 2023-10-29 16:55:05,095 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:05,095 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:05,095 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:05,095 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:05,095 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,095 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:05,095 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:05,096 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,096 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:05,097 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,097 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:05,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:05,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@761371d0[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:05,098 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:05,098 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,098 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:05,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:05,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:05,099 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,099 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:05,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:05,099 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,099 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:05,100 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:05,101 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:05,101 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:05,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:05,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:05,101 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,101 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:05,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:05,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,102 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:05,103 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,107 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:05,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:05,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:05,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:05,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:05,109 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:05,109 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,110 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,110 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,110 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:05,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:05,110 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:05,110 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:05,210 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:05,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:05,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:05,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:05,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,215 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:05,215 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:05,215 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:05,215 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:05,216 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,216 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,217 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,217 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:05,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:05,217 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:05,217 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:05,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,218 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:05,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,218 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,218 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:05,218 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:05,218 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:05,218 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:05,218 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:05,218 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:05,219 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:05,219 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:05,219 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:05,219 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:05,629 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281d79a688b68343788ea7064829cb8b9f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281d79a688b68343788ea7064829cb8b9f 2023-10-29 16:55:06,034 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/6dee43140e6944e8b3768abb8168d906 2023-10-29 16:55:06,046 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/6dee43140e6944e8b3768abb8168d906 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906 2023-10-29 16:55:06,054 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 16:55:06,055 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 836ms, sequenceid=21, compaction requested=true 2023-10-29 16:55:06,056 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:06,056 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:06,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:06,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:06,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:06,056 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:06,058 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:06,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:06,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d5a6b0f[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:06,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:06,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,062 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:06,062 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:06,062 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:06,062 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,062 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:06,062 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:06,062 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,062 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:06,063 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:06,064 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:06,064 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:06,064 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:06,064 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,064 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:06,066 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,066 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:06,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,066 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:06,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:06,066 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,067 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,068 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:06,068 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:06,068 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:06,068 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:06,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:06,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:06,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:06,069 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:06,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:06,169 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:06,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:06,177 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:06,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:06,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,179 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:06,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:06,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:06,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:06,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,180 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,182 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:06,182 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:06,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:06,182 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:06,183 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:06,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:06,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,184 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,185 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:06,185 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:06,185 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:06,185 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:06,186 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:06,606 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123100fd3aa5cfd64fd88cb197bd9b6ad076 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123100fd3aa5cfd64fd88cb197bd9b6ad076 2023-10-29 16:55:06,905 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:55:07,014 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/bb804b63f57c4242a28039d5c5e937b5 2023-10-29 16:55:07,022 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/bb804b63f57c4242a28039d5c5e937b5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5 2023-10-29 16:55:07,029 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 16:55:07,030 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 843ms, sequenceid=25, compaction requested=true 2023-10-29 16:55:07,030 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:07,030 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:07,030 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:07,030 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:07,030 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,030 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:07,030 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,032 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:07,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:07,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:07,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e5ca808[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:07,035 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:07,035 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,036 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,037 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:07,037 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:07,037 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:07,037 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,037 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:07,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:07,038 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:07,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:07,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:07,042 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:07,042 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:07,042 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:07,042 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,042 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:07,052 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,052 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,052 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:07,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:07,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:07,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,053 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:07,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,056 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:07,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:07,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:07,061 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:07,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:07,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:07,061 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:07,061 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:07,060 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,061 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:07,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:07,061 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:07,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,061 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,062 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,062 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,062 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:07,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:07,162 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:07,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:07,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:07,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:07,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,176 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:07,176 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:07,176 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:07,176 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:07,177 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,177 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,178 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:07,178 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:07,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:07,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:07,179 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:07,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:07,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,181 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,181 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:07,182 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:07,182 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:07,182 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:07,182 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:07,182 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:07,182 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:07,182 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:07,182 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:07,182 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:07,606 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b2bcabb1fc5d4b0898c133249531fd83 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b2bcabb1fc5d4b0898c133249531fd83 2023-10-29 16:55:08,014 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/db3b6a38a53744f881547c3cb53aa94f 2023-10-29 16:55:08,025 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/db3b6a38a53744f881547c3cb53aa94f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f 2023-10-29 16:55:08,030 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 16:55:08,031 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 849ms, sequenceid=29, compaction requested=true 2023-10-29 16:55:08,032 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:08,032 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:08,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:08,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:08,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:08,032 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,034 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,034 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:08,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:08,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:08,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:08,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a443744[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:08,037 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:08,037 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,038 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:08,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:08,038 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:08,038 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,038 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:08,039 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:08,039 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,039 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:08,039 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:08,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:08,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:08,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:08,041 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:08,041 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:08,041 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:08,041 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,041 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:08,042 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,042 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,042 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:08,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:08,042 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,043 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,044 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,044 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:08,044 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,044 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:08,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:08,045 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:08,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:08,045 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,045 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,045 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:08,145 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:08,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:08,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:08,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,158 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:08,158 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:08,158 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:08,158 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:08,159 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,159 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,160 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,160 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:08,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:08,161 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:08,161 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:08,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,163 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,163 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:08,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:08,163 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:08,163 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:08,163 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:08,164 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:08,164 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:08,164 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:08,164 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:08,164 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:08,581 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d3de061028874263af5cfbae87cfd638 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3de061028874263af5cfbae87cfd638 2023-10-29 16:55:08,990 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/24dfed8ff49741649aedd55a2c1aa697 2023-10-29 16:55:09,003 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/24dfed8ff49741649aedd55a2c1aa697 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697 2023-10-29 16:55:09,008 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 16:55:09,009 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 845ms, sequenceid=33, compaction requested=true 2023-10-29 16:55:09,009 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:09,009 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:09,009 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:09,010 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,010 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:09,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,011 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:09,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:09,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:09,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57b44c2d[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:09,013 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:09,013 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,014 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,014 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:09,014 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:09,014 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:09,014 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,014 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:09,016 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,016 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:09,017 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:09,017 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:09,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:09,021 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:09,022 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:09,022 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:09,022 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,022 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:09,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:09,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,026 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:09,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:09,027 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,029 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:09,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:09,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:09,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:09,035 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:09,035 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:09,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:09,036 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:09,036 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:09,036 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,036 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,136 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:09,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:09,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:09,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:09,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,151 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:09,151 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:09,151 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:09,151 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:09,151 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,152 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,153 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:09,153 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:09,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:09,153 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,153 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:09,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:09,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,155 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:09,155 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:09,155 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:09,155 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:09,155 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:09,155 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:09,170 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078658e2da93ba44698250101fddda6f6e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509078658e2da93ba44698250101fddda6f6e 2023-10-29 16:55:09,575 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/52ff4b319f7f44d5a0678c4e0fecfb98 2023-10-29 16:55:09,580 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/52ff4b319f7f44d5a0678c4e0fecfb98 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98 2023-10-29 16:55:09,583 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 16:55:09,584 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 429ms, sequenceid=37, compaction requested=true 2023-10-29 16:55:09,584 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:09,584 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:09,584 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:09,584 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:09,584 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,584 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:09,584 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:09,585 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,585 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:09,586 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,586 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:09,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:09,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@593847c7[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:09,588 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:09,588 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,589 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:09,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:09,589 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:09,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:09,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:09,590 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:09,591 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:09,591 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,591 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:09,592 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,592 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:09,593 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,593 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:09,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,595 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:09,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,602 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:09,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:09,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:09,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:09,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:09,602 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:09,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:09,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:09,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:09,702 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:09,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:09,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:09,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:09,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,708 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:09,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:09,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 16:55:09,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 16:55:09,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,710 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,710 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:09,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:09,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:09,710 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:09,710 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:09,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:09,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,711 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,711 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 16:55:09,711 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:09,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 16:55:09,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:09,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 16:55:09,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 16:55:09,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:09,711 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:09,711 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. started... 2023-10-29 16:55:09,711 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 92187c452d6486655f87bc0d417de8a6 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 16:55:10,122 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ff745ca6bca344a6812bd60d8d232698 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ff745ca6bca344a6812bd60d8d232698 2023-10-29 16:55:10,527 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/5600ea9b88744ca4b4b341f282ba312e 2023-10-29 16:55:10,533 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/5600ea9b88744ca4b4b341f282ba312e as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e 2023-10-29 16:55:10,537 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 16:55:10,538 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 92187c452d6486655f87bc0d417de8a6 in 827ms, sequenceid=41, compaction requested=true 2023-10-29 16:55:10,538 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:10,538 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:10,538 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 16:55:10,538 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 16:55:10,538 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,538 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 16:55:10,538 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 16:55:10,539 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,539 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:10,540 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,540 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:10,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 16:55:10,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@423fb800[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:10,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 16:55:10,541 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,541 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,541 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 16:55:10,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 16:55:10,542 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,542 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:10,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:10,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 16:55:10,542 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:10,542 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 16:55:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:10,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 16:55:10,545 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 16:55:10,545 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:10,545 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:10,545 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,545 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:10,546 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:10,546 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:10,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:10,546 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,547 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,548 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,548 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:10,548 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:10,548 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:10,548 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:10,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 16:55:10,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:10,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 16:55:10,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:10,548 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,549 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,649 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:10,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:10,651 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-29 16:55:10,652 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:55:10,653 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:55:10,654 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:55:10,654 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599110654 2023-10-29 16:55:10,656 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 16:55:10,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 16:55:10,657 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:10,658 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x28290cc9 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:55:10,674 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c760961, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:55:10,675 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:11,106 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010359b614c7648d47e189e57edcc3bec7d7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010359b614c7648d47e189e57edcc3bec7d7 2023-10-29 16:55:11,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:11,118 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:55:11,120 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40392, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:55:11,135 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:55:11,136 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:55:11,154 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/55967648837e45438826efb24d131b0a first=Optional[r5] last=Optional[r6] 2023-10-29 16:55:11,155 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/55967648837e45438826efb24d131b0a}] 2023-10-29 16:55:11,164 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/55967648837e45438826efb24d131b0a for inclusion in 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:11,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 16:55:11,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:55:11,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:11,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/55967648837e45438826efb24d131b0a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qvqeeakbo68hqairl7k996cbimf8p7pug25clff8ovfk7mupt4ta0cqtul9v24ig/family1/55967648837e45438826efb24d131b0a 2023-10-29 16:55:11,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qvqeeakbo68hqairl7k996cbimf8p7pug25clff8ovfk7mupt4ta0cqtul9v24ig/family1/55967648837e45438826efb24d131b0a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_ 2023-10-29 16:55:11,169 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qvqeeakbo68hqairl7k996cbimf8p7pug25clff8ovfk7mupt4ta0cqtul9v24ig/family1/55967648837e45438826efb24d131b0a into 92187c452d6486655f87bc0d417de8a6/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_ - updating store file list. 2023-10-29 16:55:11,172 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_ into 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:11,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qvqeeakbo68hqairl7k996cbimf8p7pug25clff8ovfk7mupt4ta0cqtul9v24ig/family1/55967648837e45438826efb24d131b0a into 92187c452d6486655f87bc0d417de8a6/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_) 2023-10-29 16:55:11,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__qvqeeakbo68hqairl7k996cbimf8p7pug25clff8ovfk7mupt4ta0cqtul9v24ig/family1/55967648837e45438826efb24d131b0a 2023-10-29 16:55:11,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 16:55:11,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 16:55:11,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(1912): 92187c452d6486655f87bc0d417de8a6/family1 is initiating minor compaction 2023-10-29 16:55:11,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5ac69e5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:55:11,176 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 92187c452d6486655f87bc0d417de8a6/family1 in testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:11,177 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp, totalSize=49.7 K 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 0930c250b52b45afbd669188fcdcc4cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 492c076a8f3c48eea2485f021403bc20, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting d4c301607dee40d9818c83ce61873efc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 6dee43140e6944e8b3768abb8168d906, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting bb804b63f57c4242a28039d5c5e937b5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting db3b6a38a53744f881547c3cb53aa94f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 24dfed8ff49741649aedd55a2c1aa697, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 52ff4b319f7f44d5a0678c4e0fecfb98, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 5600ea9b88744ca4b4b341f282ba312e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 16:55:11,177 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 16:55:11,179 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:11,180 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:11,183 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b2bcabb1fc5d4b0898c133249531fd83 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101b2bcabb1fc5d4b0898c133249531fd83 2023-10-29 16:55:11,185 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3de061028874263af5cfbae87cfd638 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103d3de061028874263af5cfbae87cfd638 2023-10-29 16:55:11,185 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 16:55:11,185 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 16:55:11,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:11,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:11,210 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 92187c452d6486655f87bc0d417de8a6#family1#compaction#165 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:11,238 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ea7fbfd1d41b4015a753194857670b23 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231ea7fbfd1d41b4015a753194857670b23 2023-10-29 16:55:11,239 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:11,258 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/db6115936f0b4c5ab7fab01b826e35ba first=Optional[r1] last=Optional[r4] 2023-10-29 16:55:11,259 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/db6115936f0b4c5ab7fab01b826e35ba}] 2023-10-29 16:55:11,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/db6115936f0b4c5ab7fab01b826e35ba for inclusion in 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:11,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 16:55:11,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:55:11,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:11,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/db6115936f0b4c5ab7fab01b826e35ba to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__r18mm25f7v8b45kukesclec9ufddqq4q0kc2dbtd8a7fv22kojujglffmt1d7qvb/family1/db6115936f0b4c5ab7fab01b826e35ba 2023-10-29 16:55:11,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__r18mm25f7v8b45kukesclec9ufddqq4q0kc2dbtd8a7fv22kojujglffmt1d7qvb/family1/db6115936f0b4c5ab7fab01b826e35ba as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_ 2023-10-29 16:55:11,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__r18mm25f7v8b45kukesclec9ufddqq4q0kc2dbtd8a7fv22kojujglffmt1d7qvb/family1/db6115936f0b4c5ab7fab01b826e35ba into 92187c452d6486655f87bc0d417de8a6/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_ - updating store file list. 2023-10-29 16:55:11,275 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_ into 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:11,276 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__r18mm25f7v8b45kukesclec9ufddqq4q0kc2dbtd8a7fv22kojujglffmt1d7qvb/family1/db6115936f0b4c5ab7fab01b826e35ba into 92187c452d6486655f87bc0d417de8a6/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_) 2023-10-29 16:55:11,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__r18mm25f7v8b45kukesclec9ufddqq4q0kc2dbtd8a7fv22kojujglffmt1d7qvb/family1/db6115936f0b4c5ab7fab01b826e35ba 2023-10-29 16:55:11,278 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:11,278 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:11,279 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016773139966d748cf8932e35d21163e91 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512016773139966d748cf8932e35d21163e91 2023-10-29 16:55:11,280 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058ff57d32d4f74446ab854f0ac2fd2f6b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512058ff57d32d4f74446ab854f0ac2fd2f6b 2023-10-29 16:55:11,282 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281d79a688b68343788ea7064829cb8b9f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281d79a688b68343788ea7064829cb8b9f 2023-10-29 16:55:11,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123100fd3aa5cfd64fd88cb197bd9b6ad076 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123100fd3aa5cfd64fd88cb197bd9b6ad076 2023-10-29 16:55:11,283 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 16:55:11,283 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 16:55:11,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:11,283 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:11,629 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/720f403cc7024f5b989e186cf60f0dfb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/720f403cc7024f5b989e186cf60f0dfb 2023-10-29 16:55:11,634 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 92187c452d6486655f87bc0d417de8a6/family1 of 92187c452d6486655f87bc0d417de8a6 into 720f403cc7024f5b989e186cf60f0dfb(size=6.6 K), total size for store is 178.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:55:11,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:11,634 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698598511176; duration=0sec 2023-10-29 16:55:11,634 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:55:11,682 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_] to archive 2023-10-29 16:55:11,683 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:11,685 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/0930c250b52b45afbd669188fcdcc4cb 2023-10-29 16:55:11,686 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/492c076a8f3c48eea2485f021403bc20 2023-10-29 16:55:11,687 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/d4c301607dee40d9818c83ce61873efc 2023-10-29 16:55:11,688 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/6dee43140e6944e8b3768abb8168d906 2023-10-29 16:55:11,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/bb804b63f57c4242a28039d5c5e937b5 2023-10-29 16:55:11,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/db3b6a38a53744f881547c3cb53aa94f 2023-10-29 16:55:11,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/24dfed8ff49741649aedd55a2c1aa697 2023-10-29 16:55:11,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/52ff4b319f7f44d5a0678c4e0fecfb98 2023-10-29 16:55:11,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/5600ea9b88744ca4b4b341f282ba312e 2023-10-29 16:55:11,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/fa3201c69a2b4ff682b8ec852ccf8770_SeqId_44_ 2023-10-29 16:55:12,131 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130220fe3e5c2bf4a849ff12d418f2a729c to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130220fe3e5c2bf4a849ff12d418f2a729c 2023-10-29 16:55:12,132 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:12,152 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4262866f76494dff9e123006deddc5fb first=Optional[r00] last=Optional[r8] 2023-10-29 16:55:12,153 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4262866f76494dff9e123006deddc5fb}] 2023-10-29 16:55:12,155 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4262866f76494dff9e123006deddc5fb for inclusion in 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:12,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 16:55:12,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 16:55:12,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:12,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/4262866f76494dff9e123006deddc5fb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2gavf66bv8ih97s28el1jrmusp199d45am8acemaoqns15podne5renhg2eopdqn/family1/4262866f76494dff9e123006deddc5fb 2023-10-29 16:55:12,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2gavf66bv8ih97s28el1jrmusp199d45am8acemaoqns15podne5renhg2eopdqn/family1/4262866f76494dff9e123006deddc5fb as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_ 2023-10-29 16:55:12,161 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2gavf66bv8ih97s28el1jrmusp199d45am8acemaoqns15podne5renhg2eopdqn/family1/4262866f76494dff9e123006deddc5fb into 92187c452d6486655f87bc0d417de8a6/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_ - updating store file list. 2023-10-29 16:55:12,165 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_ into 92187c452d6486655f87bc0d417de8a6/family1 2023-10-29 16:55:12,165 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2gavf66bv8ih97s28el1jrmusp199d45am8acemaoqns15podne5renhg2eopdqn/family1/4262866f76494dff9e123006deddc5fb into 92187c452d6486655f87bc0d417de8a6/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_) 2023-10-29 16:55:12,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMinorCompactionWithMonthlyPolicy__2gavf66bv8ih97s28el1jrmusp199d45am8acemaoqns15podne5renhg2eopdqn/family1/4262866f76494dff9e123006deddc5fb 2023-10-29 16:55:12,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 16:55:12,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 352581 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 16:55:12,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(1912): 92187c452d6486655f87bc0d417de8a6/family1 is initiating minor compaction (all files) 2023-10-29 16:55:12,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1fe8b86c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:55:12,166 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 92187c452d6486655f87bc0d417de8a6/family1 in testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:12,167 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/720f403cc7024f5b989e186cf60f0dfb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp, totalSize=344.3 K 2023-10-29 16:55:12,167 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting ff7eb68c23a84d268eca9ad4270dc3bc, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850293 2023-10-29 16:55:12,167 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 720f403cc7024f5b989e186cf60f0dfb, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250293 2023-10-29 16:55:12,168 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 460dad652a1649389bfcffd505176efa_SeqId_46_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448965250293 2023-10-29 16:55:12,168 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] compactions.Compactor(207): Compacting 9750f62824204ba98187c4c12d1e322d_SeqId_49_, keycount=1001, bloomtype=ROW, size=166.2 K, encoding=NONE, compression=NONE, seqNum=50, earliestPutTs=1448014850293 2023-10-29 16:55:12,168 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:12,169 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:12,170 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ff745ca6bca344a6812bd60d8d232698 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120ff745ca6bca344a6812bd60d8d232698 2023-10-29 16:55:12,170 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bffaf086df7449db9cb44e1e3955c7d4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128bffaf086df7449db9cb44e1e3955c7d4 2023-10-29 16:55:12,171 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113057c1455a08d546a8b41fcb0d7825019b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113057c1455a08d546a8b41fcb0d7825019b 2023-10-29 16:55:12,171 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 16:55:12,171 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 16:55:12,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:12,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:12,172 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 16:55:12,172 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 16:55:12,172 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:55:12,175 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 16:55:12,177 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5240 sec 2023-10-29 16:55:12,184 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] throttle.PressureAwareThroughputController(145): 92187c452d6486655f87bc0d417de8a6#family1#compaction#166 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:12,337 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=264 (was 250) - Thread LEAK? -, OpenFileDescriptor=655 (was 635) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 252), ProcessCount=168 (was 168), AvailableMemoryMB=3598 (was 2623) - AvailableMemoryMB LEAK? - 2023-10-29 16:55:12,346 INFO [Listener at localhost/45209] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=264, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=168, AvailableMemoryMB=3598 2023-10-29 16:55:12,361 DEBUG [Listener at localhost/45209] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-29 16:55:12,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xDC%\xBEAZ\x82O\xC5\xEA\x9BxQ\x81\xDF\x99\x9F"\x10>\xFDZ\x00H\xD0]9\xDFr\x01\x83KYX\x17*\x10\xA3RJ\xB0H\xEEf\x0B \xBD\x16\x11U\xE7\x03\x082\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 16:55:12,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-29 16:55:12,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 16:55:12,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-29 16:55:12,404 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 16:55:12,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115 empty. 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e empty. 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d empty. 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:12,406 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d 2023-10-29 16:55:12,406 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-29 16:55:12,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:12,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:12,814 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-29 16:55:12,816 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 611c3dca449d24c3f11e484e3de1e115, NAME => 'testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xDC%\xBEAZ\x82O\xC5\xEA\x9BxQ\x81\xDF\x99\x9F"\x10>\xFDZ\x00H\xD0]9\xDFr\x01\x83KYX\x17*\x10\xA3RJ\xB0H\xEEf\x0B \xBD\x16\x11U\xE7\x03\x082\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:55:12,816 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 4a772aadd544166a447714365edccc5d, NAME => 'testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xDC%\xBEAZ\x82O\xC5\xEA\x9BxQ\x81\xDF\x99\x9F"\x10>\xFDZ\x00H\xD0]9\xDFr\x01\x83KYX\x17*\x10\xA3RJ\xB0H\xEEf\x0B \xBD\x16\x11U\xE7\x03\x082\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:55:12,817 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7c0fca5c4fcfe7c4074cd73394563f6e, NAME => 'testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xDC%\xBEAZ\x82O\xC5\xEA\x9BxQ\x81\xDF\x99\x9F"\x10>\xFDZ\x00H\xD0]9\xDFr\x01\x83KYX\x17*\x10\xA3RJ\xB0H\xEEf\x0B \xBD\x16\x11U\xE7\x03\x082\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/.tmp 2023-10-29 16:55:13,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:13,008 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/.tmp/family1/55c54517d9db41e39aada7c58702d531 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/55c54517d9db41e39aada7c58702d531 2023-10-29 16:55:13,014 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 92187c452d6486655f87bc0d417de8a6/family1 of 92187c452d6486655f87bc0d417de8a6 into 55c54517d9db41e39aada7c58702d531(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:55:13,014 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:13,014 INFO [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6., storeName=family1, fileCount=4, fileSize=344.3 K (166.0 K, 6.6 K, 5.5 K, 166.2 K), priority=2, time=1698598512166; duration=0sec 2023-10-29 16:55:13,015 DEBUG [RS:0;jenkins-hbase20:43165-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 16:55:13,085 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/720f403cc7024f5b989e186cf60f0dfb, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_] to archive 2023-10-29 16:55:13,087 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:13,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/ff7eb68c23a84d268eca9ad4270dc3bc 2023-10-29 16:55:13,092 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/720f403cc7024f5b989e186cf60f0dfb to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/720f403cc7024f5b989e186cf60f0dfb 2023-10-29 16:55:13,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/460dad652a1649389bfcffd505176efa_SeqId_46_ 2023-10-29 16:55:13,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_ to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/family1/9750f62824204ba98187c4c12d1e322d_SeqId_49_ 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 4a772aadd544166a447714365edccc5d, disabling compactions & flushes 2023-10-29 16:55:13,231 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 611c3dca449d24c3f11e484e3de1e115, disabling compactions & flushes 2023-10-29 16:55:13,232 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,232 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,232 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. after waiting 0 ms 2023-10-29 16:55:13,232 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,232 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,232 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:13,231 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 7c0fca5c4fcfe7c4074cd73394563f6e, disabling compactions & flushes 2023-10-29 16:55:13,232 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. after waiting 0 ms 2023-10-29 16:55:13,233 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. after waiting 0 ms 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,233 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:13,233 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:13,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 16:55:13,240 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598513240"}]},"ts":"1698598513240"} 2023-10-29 16:55:13,241 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698598513240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598513240"}]},"ts":"1698598513240"} 2023-10-29 16:55:13,241 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513240"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698598513240"}]},"ts":"1698598513240"} 2023-10-29 16:55:13,244 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 16:55:13,245 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 16:55:13,246 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598513246"}]},"ts":"1698598513246"} 2023-10-29 16:55:13,248 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-29 16:55:13,252 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=611c3dca449d24c3f11e484e3de1e115, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7c0fca5c4fcfe7c4074cd73394563f6e, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4a772aadd544166a447714365edccc5d, ASSIGN}] 2023-10-29 16:55:13,255 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=611c3dca449d24c3f11e484e3de1e115, ASSIGN 2023-10-29 16:55:13,255 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7c0fca5c4fcfe7c4074cd73394563f6e, ASSIGN 2023-10-29 16:55:13,255 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4a772aadd544166a447714365edccc5d, ASSIGN 2023-10-29 16:55:13,255 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=611c3dca449d24c3f11e484e3de1e115, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:55:13,256 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7c0fca5c4fcfe7c4074cd73394563f6e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:55:13,256 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4a772aadd544166a447714365edccc5d, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,43165,1698598366173; forceNewPlan=false, retain=false 2023-10-29 16:55:13,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7c0fca5c4fcfe7c4074cd73394563f6e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=4a772aadd544166a447714365edccc5d, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698598513409"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598513409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598513409"}]},"ts":"1698598513409"} 2023-10-29 16:55:13,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598513410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598513410"}]},"ts":"1698598513410"} 2023-10-29 16:55:13,410 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=611c3dca449d24c3f11e484e3de1e115, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,411 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513409"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698598513409"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698598513409"}]},"ts":"1698598513409"} 2023-10-29 16:55:13,414 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 7c0fca5c4fcfe7c4074cd73394563f6e, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:55:13,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 4a772aadd544166a447714365edccc5d, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:55:13,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 611c3dca449d24c3f11e484e3de1e115, server=jenkins-hbase20.apache.org,43165,1698598366173}] 2023-10-29 16:55:13,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:13,567 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a772aadd544166a447714365edccc5d, NAME => 'testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 16:55:13,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,601 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,602 DEBUG [StoreOpener-4a772aadd544166a447714365edccc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1 2023-10-29 16:55:13,602 DEBUG [StoreOpener-4a772aadd544166a447714365edccc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1 2023-10-29 16:55:13,603 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a772aadd544166a447714365edccc5d columnFamilyName family1 2023-10-29 16:55:13,604 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] regionserver.HStore(310): Store=4a772aadd544166a447714365edccc5d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,604 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,605 DEBUG [StoreOpener-4a772aadd544166a447714365edccc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2 2023-10-29 16:55:13,605 DEBUG [StoreOpener-4a772aadd544166a447714365edccc5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2 2023-10-29 16:55:13,605 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a772aadd544166a447714365edccc5d columnFamilyName family2 2023-10-29 16:55:13,607 INFO [StoreOpener-4a772aadd544166a447714365edccc5d-1] regionserver.HStore(310): Store=4a772aadd544166a447714365edccc5d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:55:13,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:13,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:55:13,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4a772aadd544166a447714365edccc5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59091737, jitterRate=-0.11946450173854828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:55:13,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:13,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d., pid=121, masterSystemTime=1698598513567 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:13,613 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 611c3dca449d24c3f11e484e3de1e115, NAME => 'testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 16:55:13,613 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=4a772aadd544166a447714365edccc5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,613 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513613"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598513613"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598513613"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598513613"}]},"ts":"1698598513613"} 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-10-29 16:55:13,615 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 4a772aadd544166a447714365edccc5d, server=jenkins-hbase20.apache.org,43165,1698598366173 in 199 msec 2023-10-29 16:55:13,616 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=4a772aadd544166a447714365edccc5d, ASSIGN in 363 msec 2023-10-29 16:55:13,630 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,631 DEBUG [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1 2023-10-29 16:55:13,631 DEBUG [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1 2023-10-29 16:55:13,632 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 611c3dca449d24c3f11e484e3de1e115 columnFamilyName family1 2023-10-29 16:55:13,632 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] regionserver.HStore(310): Store=611c3dca449d24c3f11e484e3de1e115/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,632 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,633 DEBUG [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2 2023-10-29 16:55:13,633 DEBUG [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2 2023-10-29 16:55:13,633 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 611c3dca449d24c3f11e484e3de1e115 columnFamilyName family2 2023-10-29 16:55:13,634 INFO [StoreOpener-611c3dca449d24c3f11e484e3de1e115-1] regionserver.HStore(310): Store=611c3dca449d24c3f11e484e3de1e115/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:55:13,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:55:13,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 611c3dca449d24c3f11e484e3de1e115; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71517003, jitterRate=0.06568638980388641}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:55:13,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:13,639 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115., pid=122, masterSystemTime=1698598513567 2023-10-29 16:55:13,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:13,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c0fca5c4fcfe7c4074cd73394563f6e, NAME => 'testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 16:55:13,640 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=611c3dca449d24c3f11e484e3de1e115, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,640 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698598513640"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598513640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598513640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598513640"}]},"ts":"1698598513640"} 2023-10-29 16:55:13,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 16:55:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=117 2023-10-29 16:55:13,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 611c3dca449d24c3f11e484e3de1e115, server=jenkins-hbase20.apache.org,43165,1698598366173 in 225 msec 2023-10-29 16:55:13,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=611c3dca449d24c3f11e484e3de1e115, ASSIGN in 391 msec 2023-10-29 16:55:13,661 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,662 DEBUG [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1 2023-10-29 16:55:13,662 DEBUG [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1 2023-10-29 16:55:13,662 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c0fca5c4fcfe7c4074cd73394563f6e columnFamilyName family1 2023-10-29 16:55:13,663 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] regionserver.HStore(310): Store=7c0fca5c4fcfe7c4074cd73394563f6e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,663 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,664 DEBUG [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2 2023-10-29 16:55:13,665 DEBUG [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2 2023-10-29 16:55:13,665 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c0fca5c4fcfe7c4074cd73394563f6e columnFamilyName family2 2023-10-29 16:55:13,665 INFO [StoreOpener-7c0fca5c4fcfe7c4074cd73394563f6e-1] regionserver.HStore(310): Store=7c0fca5c4fcfe7c4074cd73394563f6e/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 16:55:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 16:55:13,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 16:55:13,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7c0fca5c4fcfe7c4074cd73394563f6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67699075, jitterRate=0.008794829249382019}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 16:55:13,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:13,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e., pid=120, masterSystemTime=1698598513567 2023-10-29 16:55:13,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:13,671 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=7c0fca5c4fcfe7c4074cd73394563f6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:13,671 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698598513671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698598513671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698598513671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698598513671"}]},"ts":"1698598513671"} 2023-10-29 16:55:13,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=118 2023-10-29 16:55:13,673 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 7c0fca5c4fcfe7c4074cd73394563f6e, server=jenkins-hbase20.apache.org,43165,1698598366173 in 259 msec 2023-10-29 16:55:13,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-10-29 16:55:13,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=7c0fca5c4fcfe7c4074cd73394563f6e, ASSIGN in 421 msec 2023-10-29 16:55:13,674 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 16:55:13,674 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698598513674"}]},"ts":"1698598513674"} 2023-10-29 16:55:13,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-29 16:55:13,678 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 16:55:13,679 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2770 sec 2023-10-29 16:55:14,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 16:55:14,512 INFO [Listener at localhost/45209] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-29 16:55:14,523 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:14,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:14,524 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:14,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:14,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 16:55:14,528 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 16:55:14,528 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:14,529 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 16:55:14,529 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 16:55:14,529 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:14,529 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:14,530 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:14,530 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:14,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:14,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:14,530 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:14,531 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:14,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:14,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:14,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:14,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 16:55:14,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 16:55:14,532 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 16:55:14,532 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:14,532 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 16:55:14,532 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:14,532 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. started... 2023-10-29 16:55:14,532 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:14,532 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:55:14,533 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a772aadd544166a447714365edccc5d 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:55:14,532 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:14,532 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. started... 2023-10-29 16:55:14,533 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. started... 2023-10-29 16:55:14,533 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:14,535 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 611c3dca449d24c3f11e484e3de1e115 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:55:14,535 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7c0fca5c4fcfe7c4074cd73394563f6e 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 16:55:14,989 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ceaa6b8764904dd886621a5d94b98260 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029ceaa6b8764904dd886621a5d94b98260 2023-10-29 16:55:14,989 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029f74c6a7962544d9bb3271516b88fcdae to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f74c6a7962544d9bb3271516b88fcdae 2023-10-29 16:55:14,989 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029f0a51c6622444166b680d5c15210b077 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f0a51c6622444166b680d5c15210b077 2023-10-29 16:55:15,002 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d 2023-10-29 16:55:15,403 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/8f2449028563435b8fa233fa3d62fcb2 2023-10-29 16:55:15,407 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/b1a66bb593cb46dfad4c80fb39d46602 2023-10-29 16:55:15,430 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029ab38f4dc4b684fac97d10fa778edd793 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029ab38f4dc4b684fac97d10fa778edd793 2023-10-29 16:55:15,836 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/432fcbd2cff34c07b77c3af668db4920 2023-10-29 16:55:15,841 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d 2023-10-29 16:55:15,845 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310298ceae3869b3b4bb39c7227a80577f70e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310298ceae3869b3b4bb39c7227a80577f70e 2023-10-29 16:55:15,855 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295cff32f6a1c4431987396f3c40dd0144 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310295cff32f6a1c4431987396f3c40dd0144 2023-10-29 16:55:15,868 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 16:55:15,869 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/432fcbd2cff34c07b77c3af668db4920 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920 2023-10-29 16:55:15,872 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:55:15,873 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 611c3dca449d24c3f11e484e3de1e115 in 1339ms, sequenceid=5, compaction requested=false 2023-10-29 16:55:15,873 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-29 16:55:15,873 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:15,873 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:15,873 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:55:16,252 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/4bb2fa32cce342208f82c07c567c9a06 2023-10-29 16:55:16,260 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/ce1a2eae13f4449ba55a11e91046c1d1 2023-10-29 16:55:16,265 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/8f2449028563435b8fa233fa3d62fcb2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2 2023-10-29 16:55:16,268 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/b1a66bb593cb46dfad4c80fb39d46602 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602 2023-10-29 16:55:16,289 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 16:55:16,290 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/4bb2fa32cce342208f82c07c567c9a06 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06 2023-10-29 16:55:16,290 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 16:55:16,291 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/ce1a2eae13f4449ba55a11e91046c1d1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1 2023-10-29 16:55:16,293 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:55:16,294 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7c0fca5c4fcfe7c4074cd73394563f6e in 1759ms, sequenceid=5, compaction requested=false 2023-10-29 16:55:16,294 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:16,294 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:16,295 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:55:16,295 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 16:55:16,295 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4a772aadd544166a447714365edccc5d in 1762ms, sequenceid=5, compaction requested=false 2023-10-29 16:55:16,296 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:16,296 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:16,296 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:55:16,296 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:55:16,296 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,296 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 16:55:16,296 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 16:55:16,297 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,297 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:16,297 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,297 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:16,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:16,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 16:55:16,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@595a5914[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:16,299 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 16:55:16,299 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,300 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,300 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 16:55:16,300 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 16:55:16,300 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:16,300 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,300 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:16,301 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,301 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:16,301 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:16,301 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:16,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 16:55:16,302 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 16:55:16,302 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:16,302 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:16,302 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 16:55:16,302 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:16,303 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,303 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:16,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,303 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:16,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:16,304 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,304 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:16,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:16,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:16,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:16,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 16:55:16,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 16:55:16,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:16,306 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:16,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:16,306 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,407 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:16,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:16,411 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:16,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:16,412 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:16,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:16,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:16,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 16:55:16,421 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 16:55:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 16:55:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 16:55:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,421 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:16,429 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,429 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:16,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:16,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:16,429 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:16,430 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:16,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:16,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:16,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:16,431 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 16:55:16,431 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 16:55:16,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 16:55:16,431 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 16:55:16,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:16,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. started... 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:16,432 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a772aadd544166a447714365edccc5d 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. started... 2023-10-29 16:55:16,432 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:55:16,433 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:16,432 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. started... 2023-10-29 16:55:16,433 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 611c3dca449d24c3f11e484e3de1e115 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:55:16,433 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7c0fca5c4fcfe7c4074cd73394563f6e 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 16:55:16,878 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293bc4c3c1783c4d3fbb580dbc44904f9d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310293bc4c3c1783c4d3fbb580dbc44904f9d 2023-10-29 16:55:16,878 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029a14bc69818d9430a8ff95b7a3baf74e6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029a14bc69818d9430a8ff95b7a3baf74e6 2023-10-29 16:55:16,879 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297ce753d3d38e4c47a21d4117f3c89bf2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297ce753d3d38e4c47a21d4117f3c89bf2 2023-10-29 16:55:17,292 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/0104aa29c8ba49f4af9c5f6186f86ba9 2023-10-29 16:55:17,292 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/b9b8ea1f56034be6aad6042009478a72 2023-10-29 16:55:17,292 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/0809e2fa42c1405c851bc0ff510bd894 2023-10-29 16:55:17,735 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310291c061eafd23243458da607df2e1957f7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310291c061eafd23243458da607df2e1957f7 2023-10-29 16:55:17,739 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/a63290d3851447f5807d452f7030b926 2023-10-29 16:55:17,740 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310292d8371603326422899d305c7452d8866 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310292d8371603326422899d305c7452d8866 2023-10-29 16:55:17,743 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/0104aa29c8ba49f4af9c5f6186f86ba9 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9 2023-10-29 16:55:17,744 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ba34fac8ba5b45eaa5a27f8b96a43100 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029ba34fac8ba5b45eaa5a27f8b96a43100 2023-10-29 16:55:17,744 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/758f128f7a794a9b89205533f3bac851 2023-10-29 16:55:17,747 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/0809e2fa42c1405c851bc0ff510bd894 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894 2023-10-29 16:55:17,768 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 16:55:17,768 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/758f128f7a794a9b89205533f3bac851 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851 2023-10-29 16:55:17,770 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 16:55:17,770 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/a63290d3851447f5807d452f7030b926 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926 2023-10-29 16:55:17,772 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:55:17,773 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 611c3dca449d24c3f11e484e3de1e115 in 1340ms, sequenceid=9, compaction requested=false 2023-10-29 16:55:17,773 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:17,773 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:17,773 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:55:17,773 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:55:17,774 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7c0fca5c4fcfe7c4074cd73394563f6e in 1341ms, sequenceid=9, compaction requested=false 2023-10-29 16:55:17,774 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:17,774 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:17,774 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:55:18,157 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/01441af1793a4d77af23bc2ee41beaaa 2023-10-29 16:55:18,160 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/b9b8ea1f56034be6aad6042009478a72 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72 2023-10-29 16:55:18,180 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 16:55:18,181 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/01441af1793a4d77af23bc2ee41beaaa as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa 2023-10-29 16:55:18,185 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 16:55:18,185 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4a772aadd544166a447714365edccc5d in 1753ms, sequenceid=9, compaction requested=false 2023-10-29 16:55:18,185 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:18,186 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:18,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:55:18,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:55:18,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 16:55:18,186 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 16:55:18,187 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,187 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:18,187 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,187 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:18,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 16:55:18,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cfab336[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:18,188 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 16:55:18,188 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,189 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,189 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 16:55:18,189 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 16:55:18,189 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:18,189 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,189 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:18,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 16:55:18,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:18,190 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,190 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 16:55:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:18,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:18,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:18,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 16:55:18,192 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 16:55:18,192 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:18,192 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:18,192 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 16:55:18,192 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:18,193 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,193 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,193 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:18,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,194 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:18,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,194 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:18,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:18,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:18,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:18,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 16:55:18,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 16:55:18,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:18,196 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:18,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:18,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:18,196 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,297 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:18,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:18,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:18,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:18,300 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:18,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:18,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:18,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 16:55:18,308 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 16:55:18,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:18,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 16:55:18,308 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 16:55:18,309 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,309 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:18,310 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:18,310 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:18,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:18,311 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:18,311 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:18,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:18,312 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:18,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:18,313 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 16:55:18,313 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 16:55:18,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 16:55:18,313 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 16:55:18,313 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:18,313 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 16:55:18,314 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:18,314 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. started... 2023-10-29 16:55:18,314 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:55:18,314 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:18,314 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a772aadd544166a447714365edccc5d 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:55:18,314 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:18,314 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. started... 2023-10-29 16:55:18,314 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:18,315 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 611c3dca449d24c3f11e484e3de1e115 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:55:18,315 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. started... 2023-10-29 16:55:18,315 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7c0fca5c4fcfe7c4074cd73394563f6e 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 16:55:18,761 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029382d003de02c44039035333d4a7253e5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029382d003de02c44039035333d4a7253e5 2023-10-29 16:55:18,761 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029f49764ad4eab46899300f49c940964d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f49764ad4eab46899300f49c940964d2 2023-10-29 16:55:18,762 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029c6d8ba68c9f74e099291e88a660674fc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029c6d8ba68c9f74e099291e88a660674fc 2023-10-29 16:55:19,114 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 16:55:19,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/ec6c478631554d2dbe0c79e4d30c22e9 2023-10-29 16:55:19,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/7690867f9cbf4b3d916f2b745926ff45 2023-10-29 16:55:19,173 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/70a45d4693684d4cbc8f590487e6637a 2023-10-29 16:55:19,214 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310297be253c3e6d94710af6a8f015025e2f3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202310297be253c3e6d94710af6a8f015025e2f3 2023-10-29 16:55:19,619 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/31614640b7354b92bbcb43b00d714677 2023-10-29 16:55:19,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029a77d18d2a3c04340bd0c97b54676e70a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029a77d18d2a3c04340bd0c97b54676e70a 2023-10-29 16:55:19,621 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029484aa219b98740f08ebf2aa6aa2c8b1e to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231029484aa219b98740f08ebf2aa6aa2c8b1e 2023-10-29 16:55:19,624 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/7690867f9cbf4b3d916f2b745926ff45 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45 2023-10-29 16:55:19,656 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 16:55:19,657 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/31614640b7354b92bbcb43b00d714677 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677 2023-10-29 16:55:19,661 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:55:19,661 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 611c3dca449d24c3f11e484e3de1e115 in 1346ms, sequenceid=13, compaction requested=true 2023-10-29 16:55:19,661 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:19,661 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:19,661 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:55:20,041 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/decbe38e12c34bab9a76575eeca4f1f2 2023-10-29 16:55:20,042 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/e7a9085b2bec4fbd89f5dc710f995148 2023-10-29 16:55:20,050 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/ec6c478631554d2dbe0c79e4d30c22e9 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9 2023-10-29 16:55:20,051 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/70a45d4693684d4cbc8f590487e6637a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a 2023-10-29 16:55:20,070 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 16:55:20,070 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 16:55:20,070 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/decbe38e12c34bab9a76575eeca4f1f2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2 2023-10-29 16:55:20,071 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/e7a9085b2bec4fbd89f5dc710f995148 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148 2023-10-29 16:55:20,074 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:55:20,074 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 16:55:20,074 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4a772aadd544166a447714365edccc5d in 1760ms, sequenceid=13, compaction requested=true 2023-10-29 16:55:20,074 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7c0fca5c4fcfe7c4074cd73394563f6e in 1759ms, sequenceid=13, compaction requested=true 2023-10-29 16:55:20,075 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:20,075 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:20,075 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:20,075 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 16:55:20,075 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 16:55:20,076 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,076 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:20,076 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,076 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:20,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:20,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 16:55:20,077 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3767df11[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:20,077 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 16:55:20,077 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,078 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:20,078 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,078 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:20,078 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,078 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 16:55:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:20,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:20,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:20,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 16:55:20,080 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 16:55:20,080 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:20,080 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:20,080 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 16:55:20,080 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:20,081 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,081 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:20,081 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:20,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:20,081 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,082 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:20,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,084 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,084 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:20,084 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:20,084 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:20,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 16:55:20,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:20,084 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:20,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:20,084 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:20,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:20,085 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,185 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:20,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:20,188 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:20,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:20,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 16:55:20,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 16:55:20,197 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 16:55:20,197 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:20,197 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 16:55:20,197 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 16:55:20,198 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,198 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:20,199 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:20,199 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:20,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:20,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:20,200 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:20,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:20,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:20,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 16:55:20,201 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 16:55:20,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 16:55:20,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 16:55:20,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:20,201 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. started... 2023-10-29 16:55:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:55:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. started... 2023-10-29 16:55:20,202 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. started... 2023-10-29 16:55:20,202 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a772aadd544166a447714365edccc5d 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:55:20,202 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7c0fca5c4fcfe7c4074cd73394563f6e 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:55:20,202 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 611c3dca449d24c3f11e484e3de1e115 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 16:55:20,644 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d2e0680aa650469791acb4700a7ffe0d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d2e0680aa650469791acb4700a7ffe0d 2023-10-29 16:55:20,653 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102912efc26a783a4a208cbc958405134c79 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102912efc26a783a4a208cbc958405134c79 2023-10-29 16:55:20,653 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029e10c5ff2f9d4415fa2d521b343cd980f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029e10c5ff2f9d4415fa2d521b343cd980f 2023-10-29 16:55:20,666 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/e32dcc65ed074fc0860e8e875a8bfaab 2023-10-29 16:55:20,666 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/866c984821fe4120bb5cc0e41606324f 2023-10-29 16:55:21,057 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/929e1bb2652e436099be4979de62fc65 2023-10-29 16:55:21,097 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310299c969cd45bf74b85a2f12e58f5fc1c07 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310299c969cd45bf74b85a2f12e58f5fc1c07 2023-10-29 16:55:21,097 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310292620da7030bf48e58935246d0d420067 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310292620da7030bf48e58935246d0d420067 2023-10-29 16:55:21,500 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a0ace2dacaee4f20bee0bf2e521ff4a8 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029a0ace2dacaee4f20bee0bf2e521ff4a8 2023-10-29 16:55:21,502 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/1bd40235e0e84e83a211b862d90c7a95 2023-10-29 16:55:21,502 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/6c680da1369f451e9cbbc5ec445ab026 2023-10-29 16:55:21,509 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/ae20de4138c94dfda58b62eacd418fa7 2023-10-29 16:55:21,509 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/e32dcc65ed074fc0860e8e875a8bfaab as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab 2023-10-29 16:55:21,509 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/866c984821fe4120bb5cc0e41606324f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f 2023-10-29 16:55:21,520 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/929e1bb2652e436099be4979de62fc65 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65 2023-10-29 16:55:21,534 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 16:55:21,534 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/6c680da1369f451e9cbbc5ec445ab026 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026 2023-10-29 16:55:21,538 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:55:21,538 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 16:55:21,539 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4a772aadd544166a447714365edccc5d in 1337ms, sequenceid=17, compaction requested=true 2023-10-29 16:55:21,539 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/1bd40235e0e84e83a211b862d90c7a95 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95 2023-10-29 16:55:21,539 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:21,539 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:21,539 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:55:21,543 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:55:21,544 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7c0fca5c4fcfe7c4074cd73394563f6e in 1342ms, sequenceid=17, compaction requested=true 2023-10-29 16:55:21,544 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:21,544 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:21,544 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:55:21,544 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 16:55:21,545 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/ae20de4138c94dfda58b62eacd418fa7 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7 2023-10-29 16:55:21,548 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 16:55:21,549 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 611c3dca449d24c3f11e484e3de1e115 in 1347ms, sequenceid=17, compaction requested=true 2023-10-29 16:55:21,549 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:21,549 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:21,549 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:55:21,549 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:55:21,549 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,550 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 16:55:21,550 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 16:55:21,551 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,551 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:21,551 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,551 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:21,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 16:55:21,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8279e45[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:21,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 16:55:21,552 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,553 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 16:55:21,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 16:55:21,553 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:21,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,553 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:21,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 16:55:21,554 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:21,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:21,554 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 16:55:21,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:21,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:21,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 16:55:21,556 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 16:55:21,556 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:21,556 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:21,556 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 16:55:21,556 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:21,557 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:21,557 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:21,557 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,558 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:21,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:21,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:21,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,559 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:21,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:21,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 16:55:21,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:21,559 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:21,560 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:21,560 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,560 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:21,560 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:21,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:21,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:21,660 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:21,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:21,676 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:21,682 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:21,689 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:21,690 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:21,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 16:55:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 16:55:21,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 16:55:21,763 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 16:55:21,763 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:21,763 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 16:55:21,763 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 16:55:21,764 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,764 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:21,764 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,764 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:21,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:21,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:21,765 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:21,765 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 16:55:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:21,765 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 16:55:21,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:21,765 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 16:55:21,765 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 16:55:21,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 16:55:21,776 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 16:55:21,776 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 16:55:21,776 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:21,777 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 16:55:21,777 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. started... 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. started... 2023-10-29 16:55:21,777 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 4a772aadd544166a447714365edccc5d 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:55:21,777 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7c0fca5c4fcfe7c4074cd73394563f6e 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:55:21,777 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. started... 2023-10-29 16:55:21,777 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 611c3dca449d24c3f11e484e3de1e115 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 16:55:21,777 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:55:21,777 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79f578e0 to 127.0.0.1:61373 2023-10-29 16:55:21,777 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:21,778 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:55:21,778 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x28290cc9 to 127.0.0.1:61373 2023-10-29 16:55:21,778 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:21,812 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/d2efd801befb44d0abea815af6a11264 2023-10-29 16:55:21,818 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/6166cbd1ff6444698562dd645c2aef7b 2023-10-29 16:55:21,839 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2efd801befb44d0abea815af6a11264 2023-10-29 16:55:21,845 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6166cbd1ff6444698562dd645c2aef7b 2023-10-29 16:55:22,232 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/6e0886b9cd7c4ed092977ffb834e4b91 2023-10-29 16:55:22,262 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e0886b9cd7c4ed092977ffb834e4b91 2023-10-29 16:55:22,653 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a 2023-10-29 16:55:22,656 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8307ba7e7ec4c05ac4a38c0194dfc0a 2023-10-29 16:55:22,657 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/d2efd801befb44d0abea815af6a11264 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264 2023-10-29 16:55:22,660 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/4bee8de71c9741ccbcb706ba2c1782d4 2023-10-29 16:55:22,663 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bee8de71c9741ccbcb706ba2c1782d4 2023-10-29 16:55:22,663 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/6166cbd1ff6444698562dd645c2aef7b as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b 2023-10-29 16:55:22,673 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/56b5d59440034393b104b41dfc3e1a91 2023-10-29 16:55:22,677 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56b5d59440034393b104b41dfc3e1a91 2023-10-29 16:55:22,677 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/6e0886b9cd7c4ed092977ffb834e4b91 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91 2023-10-29 16:55:22,683 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2efd801befb44d0abea815af6a11264 2023-10-29 16:55:22,683 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 16:55:22,684 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a 2023-10-29 16:55:22,691 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6166cbd1ff6444698562dd645c2aef7b 2023-10-29 16:55:22,691 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8307ba7e7ec4c05ac4a38c0194dfc0a 2023-10-29 16:55:22,691 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 16:55:22,691 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:55:22,692 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/4bee8de71c9741ccbcb706ba2c1782d4 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4 2023-10-29 16:55:22,692 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4a772aadd544166a447714365edccc5d in 915ms, sequenceid=23, compaction requested=true 2023-10-29 16:55:22,692 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:22,692 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:22,692 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 16:55:22,696 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4bee8de71c9741ccbcb706ba2c1782d4 2023-10-29 16:55:22,696 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:55:22,696 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 611c3dca449d24c3f11e484e3de1e115 in 919ms, sequenceid=23, compaction requested=true 2023-10-29 16:55:22,697 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:22,697 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:22,697 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 16:55:22,702 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e0886b9cd7c4ed092977ffb834e4b91 2023-10-29 16:55:22,702 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 16:55:22,703 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/56b5d59440034393b104b41dfc3e1a91 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91 2023-10-29 16:55:22,706 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56b5d59440034393b104b41dfc3e1a91 2023-10-29 16:55:22,706 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 16:55:22,707 INFO [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7c0fca5c4fcfe7c4074cd73394563f6e in 930ms, sequenceid=23, compaction requested=true 2023-10-29 16:55:22,707 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:22,707 DEBUG [rs(jenkins-hbase20.apache.org,43165,1698598366173)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:22,707 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 16:55:22,707 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 16:55:22,707 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,707 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 16:55:22,707 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 16:55:22,708 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,708 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:22,708 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,708 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,43165,1698598366173' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 16:55:22,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bee4ac[Count = 0] remaining members to acquire global barrier 2023-10-29 16:55:22,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 16:55:22,709 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,710 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 16:55:22,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 16:55:22,710 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,43165,1698598366173' in zk 2023-10-29 16:55:22,710 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,710 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 16:55:22,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 16:55:22,711 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:22,711 DEBUG [member: 'jenkins-hbase20.apache.org,43165,1698598366173' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 16:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,43165,1698598366173': 2023-10-29 16:55:22,713 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,43165,1698598366173' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 16:55:22,713 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 16:55:22,713 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 16:55:22,713 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 16:55:22,713 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 16:55:22,713 INFO [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 16:55:22,714 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,714 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,715 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 16:55:22,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,715 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 16:55:22,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:22,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 16:55:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,716 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 16:55:22,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 16:55:22,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 16:55:22,718 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 16:55:22,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 16:55:22,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 16:55:22,718 DEBUG [(jenkins-hbase20.apache.org,42601,1698598365195)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 16:55:22,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 16:55:22,718 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 16:55:22,719 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 16:55:22,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 16:55:22,719 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 16:55:22,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 16:55:22,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 16:55:22,819 DEBUG [Listener at localhost/45209] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 16:55:22,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42601] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 16:55:22,820 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:22,820 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 4a772aadd544166a447714365edccc5d/family1 is initiating major compaction (all files) 2023-10-29 16:55:22,820 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:22,821 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:22,821 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 4a772aadd544166a447714365edccc5d/family1 in testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:22,821 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp, totalSize=27.1 K 2023-10-29 16:55:22,822 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b1a66bb593cb46dfad4c80fb39d46602, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514524 2023-10-29 16:55:22,822 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting b9b8ea1f56034be6aad6042009478a72, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516412 2023-10-29 16:55:22,823 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ec6c478631554d2dbe0c79e4d30c22e9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:22,823 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting e32dcc65ed074fc0860e8e875a8bfaab, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520189 2023-10-29 16:55:22,824 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting d2efd801befb44d0abea815af6a11264, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:22,835 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 4a772aadd544166a447714365edccc5d#family1#compaction#197 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:23,278 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del 2023-10-29 16:55:23,278 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del 2023-10-29 16:55:24,142 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a3ac954e58345bfb1080353487ba49f 2023-10-29 16:55:24,143 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family1/1a3ac954e58345bfb1080353487ba49f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/1a3ac954e58345bfb1080353487ba49f 2023-10-29 16:55:24,175 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a3ac954e58345bfb1080353487ba49f 2023-10-29 16:55:24,176 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a772aadd544166a447714365edccc5d/family1 of 4a772aadd544166a447714365edccc5d into 1a3ac954e58345bfb1080353487ba49f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:55:24,176 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:24,176 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:24,177 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 4a772aadd544166a447714365edccc5d/family2 is initiating major compaction (all files) 2023-10-29 16:55:24,177 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:24,177 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:24,178 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 4a772aadd544166a447714365edccc5d/family2 in testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:24,178 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp, totalSize=25.4 K 2023-10-29 16:55:24,178 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ce1a2eae13f4449ba55a11e91046c1d1, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514524 2023-10-29 16:55:24,179 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 01441af1793a4d77af23bc2ee41beaaa, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516412 2023-10-29 16:55:24,179 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting decbe38e12c34bab9a76575eeca4f1f2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:24,180 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6c680da1369f451e9cbbc5ec445ab026, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520189 2023-10-29 16:55:24,180 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting c8307ba7e7ec4c05ac4a38c0194dfc0a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:24,182 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264] to archive 2023-10-29 16:55:24,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:24,184 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b1a66bb593cb46dfad4c80fb39d46602 2023-10-29 16:55:24,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/b9b8ea1f56034be6aad6042009478a72 2023-10-29 16:55:24,186 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/ec6c478631554d2dbe0c79e4d30c22e9 2023-10-29 16:55:24,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/e32dcc65ed074fc0860e8e875a8bfaab 2023-10-29 16:55:24,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/d2efd801befb44d0abea815af6a11264 2023-10-29 16:55:24,191 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 4a772aadd544166a447714365edccc5d#family2#compaction#198 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:24,599 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102925f7909567024bc9ae938f5ad007b04a_del 2023-10-29 16:55:24,600 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102925f7909567024bc9ae938f5ad007b04a_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023102925f7909567024bc9ae938f5ad007b04a_del 2023-10-29 16:55:25,416 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ee6722049b430c9c2fea19419fdb9a 2023-10-29 16:55:25,417 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/.tmp/family2/c7ee6722049b430c9c2fea19419fdb9a as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c7ee6722049b430c9c2fea19419fdb9a 2023-10-29 16:55:25,421 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7ee6722049b430c9c2fea19419fdb9a 2023-10-29 16:55:25,422 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4a772aadd544166a447714365edccc5d/family2 of 4a772aadd544166a447714365edccc5d into c7ee6722049b430c9c2fea19419fdb9a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:55:25,422 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:25,423 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:25,423 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 611c3dca449d24c3f11e484e3de1e115/family1 is initiating major compaction (all files) 2023-10-29 16:55:25,423 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:25,423 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:25,423 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 611c3dca449d24c3f11e484e3de1e115/family1 in testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:25,423 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp, totalSize=27.1 K 2023-10-29 16:55:25,424 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ce877c7fe84a4eadaaeb6fa08ae7df6d, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514523 2023-10-29 16:55:25,424 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0809e2fa42c1405c851bc0ff510bd894, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516411 2023-10-29 16:55:25,424 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 7690867f9cbf4b3d916f2b745926ff45, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:25,425 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 929e1bb2652e436099be4979de62fc65, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520188 2023-10-29 16:55:25,425 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6166cbd1ff6444698562dd645c2aef7b, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:25,439 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 611c3dca449d24c3f11e484e3de1e115#family1#compaction#199 average throughput is 0.25 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:25,482 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del 2023-10-29 16:55:25,482 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del 2023-10-29 16:55:25,483 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a] to archive 2023-10-29 16:55:25,484 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:25,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/ce1a2eae13f4449ba55a11e91046c1d1 2023-10-29 16:55:25,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/01441af1793a4d77af23bc2ee41beaaa 2023-10-29 16:55:25,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/decbe38e12c34bab9a76575eeca4f1f2 2023-10-29 16:55:25,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/6c680da1369f451e9cbbc5ec445ab026 2023-10-29 16:55:25,508 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family2/c8307ba7e7ec4c05ac4a38c0194dfc0a 2023-10-29 16:55:25,952 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c57c87cf56f941a18c308c05446ec3c2 2023-10-29 16:55:25,952 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family1/c57c87cf56f941a18c308c05446ec3c2 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/c57c87cf56f941a18c308c05446ec3c2 2023-10-29 16:55:25,973 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c57c87cf56f941a18c308c05446ec3c2 2023-10-29 16:55:25,974 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 611c3dca449d24c3f11e484e3de1e115/family1 of 611c3dca449d24c3f11e484e3de1e115 into c57c87cf56f941a18c308c05446ec3c2(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 16:55:25,974 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:25,974 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:25,974 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 611c3dca449d24c3f11e484e3de1e115/family2 is initiating major compaction (all files) 2023-10-29 16:55:25,974 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:25,974 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:25,975 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 611c3dca449d24c3f11e484e3de1e115/family2 in testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:25,975 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp, totalSize=25.4 K 2023-10-29 16:55:25,975 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 432fcbd2cff34c07b77c3af668db4920, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514523 2023-10-29 16:55:25,975 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 758f128f7a794a9b89205533f3bac851, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516411 2023-10-29 16:55:25,976 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 31614640b7354b92bbcb43b00d714677, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:25,976 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting ae20de4138c94dfda58b62eacd418fa7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520188 2023-10-29 16:55:25,976 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4bee8de71c9741ccbcb706ba2c1782d4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:25,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b] to archive 2023-10-29 16:55:25,982 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:25,983 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/ce877c7fe84a4eadaaeb6fa08ae7df6d 2023-10-29 16:55:25,984 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 611c3dca449d24c3f11e484e3de1e115#family2#compaction#200 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:25,984 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/0809e2fa42c1405c851bc0ff510bd894 2023-10-29 16:55:25,985 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/7690867f9cbf4b3d916f2b745926ff45 2023-10-29 16:55:25,986 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/929e1bb2652e436099be4979de62fc65 2023-10-29 16:55:25,987 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/6166cbd1ff6444698562dd645c2aef7b 2023-10-29 16:55:26,391 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029bbb102eb02d34875adbb561a874016b2_del 2023-10-29 16:55:26,391 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029bbb102eb02d34875adbb561a874016b2_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029bbb102eb02d34875adbb561a874016b2_del 2023-10-29 16:55:27,211 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38f850a528784901b3e6c86b51cf9c48 2023-10-29 16:55:27,212 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/.tmp/family2/38f850a528784901b3e6c86b51cf9c48 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/38f850a528784901b3e6c86b51cf9c48 2023-10-29 16:55:27,216 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38f850a528784901b3e6c86b51cf9c48 2023-10-29 16:55:27,217 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 611c3dca449d24c3f11e484e3de1e115/family2 of 611c3dca449d24c3f11e484e3de1e115 into 38f850a528784901b3e6c86b51cf9c48(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:55:27,217 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:27,217 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:27,217 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 7c0fca5c4fcfe7c4074cd73394563f6e/family1 is initiating major compaction (all files) 2023-10-29 16:55:27,217 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:27,217 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:27,218 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 7c0fca5c4fcfe7c4074cd73394563f6e/family1 in testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:27,218 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp, totalSize=27.1 K 2023-10-29 16:55:27,218 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 8f2449028563435b8fa233fa3d62fcb2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514524 2023-10-29 16:55:27,219 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 0104aa29c8ba49f4af9c5f6186f86ba9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516412 2023-10-29 16:55:27,219 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 70a45d4693684d4cbc8f590487e6637a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:27,220 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 866c984821fe4120bb5cc0e41606324f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520189 2023-10-29 16:55:27,220 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 6e0886b9cd7c4ed092977ffb834e4b91, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:27,226 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 7c0fca5c4fcfe7c4074cd73394563f6e#family1#compaction#201 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:27,282 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4] to archive 2023-10-29 16:55:27,283 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:27,286 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/432fcbd2cff34c07b77c3af668db4920 2023-10-29 16:55:27,288 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/758f128f7a794a9b89205533f3bac851 2023-10-29 16:55:27,290 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/31614640b7354b92bbcb43b00d714677 2023-10-29 16:55:27,292 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/ae20de4138c94dfda58b62eacd418fa7 2023-10-29 16:55:27,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family2/4bee8de71c9741ccbcb706ba2c1782d4 2023-10-29 16:55:27,658 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del 2023-10-29 16:55:27,658 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del 2023-10-29 16:55:28,509 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 385bcd1eac9540cfa7b8b0415205c6e5 2023-10-29 16:55:28,510 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family1/385bcd1eac9540cfa7b8b0415205c6e5 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/385bcd1eac9540cfa7b8b0415205c6e5 2023-10-29 16:55:28,534 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 385bcd1eac9540cfa7b8b0415205c6e5 2023-10-29 16:55:28,534 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7c0fca5c4fcfe7c4074cd73394563f6e/family1 of 7c0fca5c4fcfe7c4074cd73394563f6e into 385bcd1eac9540cfa7b8b0415205c6e5(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:55:28,535 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:28,535 DEBUG [Listener at localhost/45209] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 16:55:28,535 DEBUG [Listener at localhost/45209] regionserver.HStore(1912): 7c0fca5c4fcfe7c4074cd73394563f6e/family2 is initiating major compaction (all files) 2023-10-29 16:55:28,535 INFO [Listener at localhost/45209] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 16:55:28,535 INFO [Listener at localhost/45209] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 16:55:28,536 INFO [Listener at localhost/45209] regionserver.HRegion(2259): Starting compaction of 7c0fca5c4fcfe7c4074cd73394563f6e/family2 in testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:28,536 INFO [Listener at localhost/45209] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91] into tmpdir=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp, totalSize=25.4 K 2023-10-29 16:55:28,536 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 4bb2fa32cce342208f82c07c567c9a06, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698598514524 2023-10-29 16:55:28,536 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting a63290d3851447f5807d452f7030b926, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698598516412 2023-10-29 16:55:28,537 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting e7a9085b2bec4fbd89f5dc710f995148, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698598518300 2023-10-29 16:55:28,537 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 1bd40235e0e84e83a211b862d90c7a95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698598520189 2023-10-29 16:55:28,537 DEBUG [Listener at localhost/45209] compactions.Compactor(207): Compacting 56b5d59440034393b104b41dfc3e1a91, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 16:55:28,545 INFO [Listener at localhost/45209] throttle.PressureAwareThroughputController(145): 7c0fca5c4fcfe7c4074cd73394563f6e#family2#compaction#202 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 16:55:28,584 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91] to archive 2023-10-29 16:55:28,585 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:28,588 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/8f2449028563435b8fa233fa3d62fcb2 2023-10-29 16:55:28,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/0104aa29c8ba49f4af9c5f6186f86ba9 2023-10-29 16:55:28,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/70a45d4693684d4cbc8f590487e6637a 2023-10-29 16:55:28,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/866c984821fe4120bb5cc0e41606324f 2023-10-29 16:55:28,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/6e0886b9cd7c4ed092977ffb834e4b91 2023-10-29 16:55:28,954 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023102918f3add54b724d478f86c205f7c7d85b_del 2023-10-29 16:55:28,954 INFO [Listener at localhost/45209] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102918f3add54b724d478f86c205f7c7d85b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023102918f3add54b724d478f86c205f7c7d85b_del 2023-10-29 16:55:29,777 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53b8f355e35a47b89fa0296b3e1a023d 2023-10-29 16:55:29,778 DEBUG [Listener at localhost/45209] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/.tmp/family2/53b8f355e35a47b89fa0296b3e1a023d as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/53b8f355e35a47b89fa0296b3e1a023d 2023-10-29 16:55:29,783 INFO [Listener at localhost/45209] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 53b8f355e35a47b89fa0296b3e1a023d 2023-10-29 16:55:29,784 INFO [Listener at localhost/45209] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7c0fca5c4fcfe7c4074cd73394563f6e/family2 of 7c0fca5c4fcfe7c4074cd73394563f6e into 53b8f355e35a47b89fa0296b3e1a023d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 16:55:29,784 DEBUG [Listener at localhost/45209] regionserver.HRegion(2289): Compaction status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:29,788 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:29,792 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:29,797 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:29,798 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:29,804 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=42601] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xDC%\xBEAZ\x82O\xC5\xEA\x9BxQ\x81\xDF\x99\x9F"\x10>\xFDZ\x00H\xD0]9\xDFr\x01\x83KYX\x17*\x10\xA3RJ\xB0H\xEEf\x0B \xBD\x16\x11U\xE7\x03\x082\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-29 16:55:29,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 16:55:29,824 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 16:55:29,825 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:55:29,825 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698599129825 2023-10-29 16:55:29,826 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 16:55:29,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91] to archive 2023-10-29 16:55:29,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:29,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/4bb2fa32cce342208f82c07c567c9a06 2023-10-29 16:55:29,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/a63290d3851447f5807d452f7030b926 2023-10-29 16:55:29,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/e7a9085b2bec4fbd89f5dc710f995148 2023-10-29 16:55:29,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/1bd40235e0e84e83a211b862d90c7a95 2023-10-29 16:55:29,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family2/56b5d59440034393b104b41dfc3e1a91 2023-10-29 16:55:30,115 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-29 16:55:30,134 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del 2023-10-29 16:55:30,154 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del 2023-10-29 16:55:30,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del 2023-10-29 16:55:30,181 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:30,182 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] zookeeper.ReadOnlyZKClient(139): Connect 0x57eb7420 to 127.0.0.1:61373 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 16:55:30,185 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a0132e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 16:55:30,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:31,142 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310292bfa974abdc941558b94b597198d1bc9 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310292bfa974abdc941558b94b597198d1bc9 2023-10-29 16:55:31,143 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:31,152 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 16:55:31,154 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49510, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 16:55:31,160 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 16:55:31,162 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:35920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 16:55:31,185 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/9d7b81cd57c84b8a9ac6522b1be0d083 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 16:55:31,186 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/9d7b81cd57c84b8a9ac6522b1be0d083}] 2023-10-29 16:55:31,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/9d7b81cd57c84b8a9ac6522b1be0d083 for inclusion in 611c3dca449d24c3f11e484e3de1e115/family1 2023-10-29 16:55:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 16:55:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 16:55:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:31,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/9d7b81cd57c84b8a9ac6522b1be0d083 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__1dhj34qtvd02t867gqe17287ccunmsdurvpm6f4rlnaengq0nifo6cq4dlu258q7/family1/9d7b81cd57c84b8a9ac6522b1be0d083 2023-10-29 16:55:31,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__1dhj34qtvd02t867gqe17287ccunmsdurvpm6f4rlnaengq0nifo6cq4dlu258q7/family1/9d7b81cd57c84b8a9ac6522b1be0d083 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/72792851be954fd880bf229920aa58a5_SeqId_28_ 2023-10-29 16:55:31,214 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__1dhj34qtvd02t867gqe17287ccunmsdurvpm6f4rlnaengq0nifo6cq4dlu258q7/family1/9d7b81cd57c84b8a9ac6522b1be0d083 into 611c3dca449d24c3f11e484e3de1e115/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/72792851be954fd880bf229920aa58a5_SeqId_28_ - updating store file list. 2023-10-29 16:55:31,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/72792851be954fd880bf229920aa58a5_SeqId_28_ into 611c3dca449d24c3f11e484e3de1e115/family1 2023-10-29 16:55:31,235 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__1dhj34qtvd02t867gqe17287ccunmsdurvpm6f4rlnaengq0nifo6cq4dlu258q7/family1/9d7b81cd57c84b8a9ac6522b1be0d083 into 611c3dca449d24c3f11e484e3de1e115/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/family1/72792851be954fd880bf229920aa58a5_SeqId_28_) 2023-10-29 16:55:31,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__1dhj34qtvd02t867gqe17287ccunmsdurvpm6f4rlnaengq0nifo6cq4dlu258q7/family1/9d7b81cd57c84b8a9ac6522b1be0d083 2023-10-29 16:55:31,237 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:31,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:31,239 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310293bc4c3c1783c4d3fbb580dbc44904f9d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310293bc4c3c1783c4d3fbb580dbc44904f9d 2023-10-29 16:55:31,240 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d2e0680aa650469791acb4700a7ffe0d to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029d2e0680aa650469791acb4700a7ffe0d 2023-10-29 16:55:31,241 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f0a51c6622444166b680d5c15210b077 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f0a51c6622444166b680d5c15210b077 2023-10-29 16:55:31,242 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f49764ad4eab46899300f49c940964d2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029f49764ad4eab46899300f49c940964d2 2023-10-29 16:55:31,242 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 16:55:31,242 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 16:55:31,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:31,242 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:32,184 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029f178536aa33f443681a1fca1c2ab1a35 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029f178536aa33f443681a1fca1c2ab1a35 2023-10-29 16:55:32,185 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:32,231 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b6f3774c7aee43c69cc21d5d70754732 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 16:55:32,232 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b6f3774c7aee43c69cc21d5d70754732}] 2023-10-29 16:55:32,234 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b6f3774c7aee43c69cc21d5d70754732 for inclusion in 4a772aadd544166a447714365edccc5d/family1 2023-10-29 16:55:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 16:55:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 16:55:32,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/b6f3774c7aee43c69cc21d5d70754732 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__uj2tgijqaeo3u7gronnkinki51muc6rqn90ehfs06mvv7l1obq8qdm0ui6qtvf6c/family1/b6f3774c7aee43c69cc21d5d70754732 2023-10-29 16:55:32,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__uj2tgijqaeo3u7gronnkinki51muc6rqn90ehfs06mvv7l1obq8qdm0ui6qtvf6c/family1/b6f3774c7aee43c69cc21d5d70754732 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/7b77e387a4874f8ebbed109627173225_SeqId_28_ 2023-10-29 16:55:32,258 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__uj2tgijqaeo3u7gronnkinki51muc6rqn90ehfs06mvv7l1obq8qdm0ui6qtvf6c/family1/b6f3774c7aee43c69cc21d5d70754732 into 4a772aadd544166a447714365edccc5d/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/7b77e387a4874f8ebbed109627173225_SeqId_28_ - updating store file list. 2023-10-29 16:55:32,282 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/7b77e387a4874f8ebbed109627173225_SeqId_28_ into 4a772aadd544166a447714365edccc5d/family1 2023-10-29 16:55:32,282 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__uj2tgijqaeo3u7gronnkinki51muc6rqn90ehfs06mvv7l1obq8qdm0ui6qtvf6c/family1/b6f3774c7aee43c69cc21d5d70754732 into 4a772aadd544166a447714365edccc5d/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/family1/7b77e387a4874f8ebbed109627173225_SeqId_28_) 2023-10-29 16:55:32,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__uj2tgijqaeo3u7gronnkinki51muc6rqn90ehfs06mvv7l1obq8qdm0ui6qtvf6c/family1/b6f3774c7aee43c69cc21d5d70754732 2023-10-29 16:55:32,284 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:32,285 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:32,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102912efc26a783a4a208cbc958405134c79 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102912efc26a783a4a208cbc958405134c79 2023-10-29 16:55:32,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029382d003de02c44039035333d4a7253e5 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029382d003de02c44039035333d4a7253e5 2023-10-29 16:55:32,288 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297ce753d3d38e4c47a21d4117f3c89bf2 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310297ce753d3d38e4c47a21d4117f3c89bf2 2023-10-29 16:55:32,289 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029ceaa6b8764904dd886621a5d94b98260 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029ceaa6b8764904dd886621a5d94b98260 2023-10-29 16:55:32,289 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 16:55:32,289 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 16:55:32,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:32,289 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:33,232 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029b6c6fcb7b8b14653b497e44ef89b95f3 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029b6c6fcb7b8b14653b497e44ef89b95f3 2023-10-29 16:55:33,234 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:33,285 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/de95428727f9432ea73410d5b33229e6 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 16:55:33,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e., hostname=jenkins-hbase20.apache.org,43165,1698598366173, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/de95428727f9432ea73410d5b33229e6}] 2023-10-29 16:55:33,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(763): Validating hfile at hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/de95428727f9432ea73410d5b33229e6 for inclusion in 7c0fca5c4fcfe7c4074cd73394563f6e/family1 2023-10-29 16:55:33,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 16:55:33,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 16:55:33,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegion(2446): Flush status journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/de95428727f9432ea73410d5b33229e6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__qohadkt1hooak7r9qnno12m4d8p6rc94b22cvl5es56k0s31uavdpbttpitcv65l/family1/de95428727f9432ea73410d5b33229e6 2023-10-29 16:55:33,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__qohadkt1hooak7r9qnno12m4d8p6rc94b22cvl5es56k0s31uavdpbttpitcv65l/family1/de95428727f9432ea73410d5b33229e6 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/43062b9c44c247e6b4b92409079745e0_SeqId_28_ 2023-10-29 16:55:33,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(849): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__qohadkt1hooak7r9qnno12m4d8p6rc94b22cvl5es56k0s31uavdpbttpitcv65l/family1/de95428727f9432ea73410d5b33229e6 into 7c0fca5c4fcfe7c4074cd73394563f6e/family1 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/43062b9c44c247e6b4b92409079745e0_SeqId_28_ - updating store file list. 2023-10-29 16:55:33,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(882): Loaded HFile hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/43062b9c44c247e6b4b92409079745e0_SeqId_28_ into 7c0fca5c4fcfe7c4074cd73394563f6e/family1 2023-10-29 16:55:33,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.HStore(855): Successfully loaded hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__qohadkt1hooak7r9qnno12m4d8p6rc94b22cvl5es56k0s31uavdpbttpitcv65l/family1/de95428727f9432ea73410d5b33229e6 into 7c0fca5c4fcfe7c4074cd73394563f6e/family1 (new location: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/family1/43062b9c44c247e6b4b92409079745e0_SeqId_28_) 2023-10-29 16:55:33,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43165] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/staging/jenkins__testMajorCompactionFromAdmin__qohadkt1hooak7r9qnno12m4d8p6rc94b22cvl5es56k0s31uavdpbttpitcv65l/family1/de95428727f9432ea73410d5b33229e6 2023-10-29 16:55:33,351 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:33,351 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:33,353 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029a14bc69818d9430a8ff95b7a3baf74e6 to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029a14bc69818d9430a8ff95b7a3baf74e6 2023-10-29 16:55:33,354 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029c6d8ba68c9f74e099291e88a660674fc to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029c6d8ba68c9f74e099291e88a660674fc 2023-10-29 16:55:33,355 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029e10c5ff2f9d4415fa2d521b343cd980f to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029e10c5ff2f9d4415fa2d521b343cd980f 2023-10-29 16:55:33,358 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f74c6a7962544d9bb3271516b88fcdae to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f74c6a7962544d9bb3271516b88fcdae 2023-10-29 16:55:33,358 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 16:55:33,358 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 16:55:33,363 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:33,363 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 16:55:33,363 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 16:55:33,363 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del] 2023-10-29 16:55:33,363 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:33,365 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297c2d7ae959ab48359bbec10547c84eef_del 2023-10-29 16:55:33,365 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 16:55:33,365 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del] 2023-10-29 16:55:33,369 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:33,371 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dac83e0d72941e6975ca8fba7ff855b_del 2023-10-29 16:55:33,371 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 16:55:33,371 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] compactions.PartitionedMobCompactor(367): [hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del] 2023-10-29 16:55:33,371 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 16:55:33,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del to hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029b6f082aabaae43dbb9b0a1c4ce93851a_del 2023-10-29 16:55:33,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 16:55:33,373 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698598370187] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 16:55:33,374 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 16:55:33,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.5510 sec 2023-10-29 16:55:33,390 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:33,392 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:33,396 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 16:55:33,396 DEBUG [Listener at localhost/45209] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 16:55:33,400 INFO [Listener at localhost/45209] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 16:55:33,432 INFO [Listener at localhost/45209] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=247 (was 264), OpenFileDescriptor=639 (was 655), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=238 (was 213) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 168), AvailableMemoryMB=3577 (was 3598) 2023-10-29 16:55:33,433 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27cfb7ff to 127.0.0.1:61373 2023-10-29 16:55:33,433 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:33,433 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-29 16:55:33,434 INFO [Listener at localhost/45209] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 16:55:33,434 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5785bd1d to 127.0.0.1:61373 2023-10-29 16:55:33,434 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:33,434 DEBUG [Listener at localhost/45209] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-29 16:55:33,434 DEBUG [Listener at localhost/45209] util.JVMClusterUtil(257): Found active master hash=1126782112, stopped=false 2023-10-29 16:55:33,434 INFO [Listener at localhost/45209] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:55:33,435 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 16:55:33,435 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 16:55:33,435 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:55:33,435 INFO [Listener at localhost/45209] procedure2.ProcedureExecutor(628): Stopping 2023-10-29 16:55:33,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 16:55:33,435 DEBUG [Listener at localhost/45209] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ee921bf to 127.0.0.1:61373 2023-10-29 16:55:33,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 16:55:33,435 DEBUG [Listener at localhost/45209] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:33,435 INFO [Listener at localhost/45209] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,43165,1698598366173' ***** 2023-10-29 16:55:33,436 INFO [Listener at localhost/45209] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-29 16:55:33,436 INFO [RS:0;jenkins-hbase20:43165] regionserver.HeapMemoryManager(220): Stopping 2023-10-29 16:55:33,436 INFO [RS:0;jenkins-hbase20:43165] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-29 16:55:33,436 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-29 16:55:33,436 INFO [RS:0;jenkins-hbase20:43165] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-29 16:55:33,436 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for e75b9d7ba9a6a0449e6a9e5cfa114a22 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 92187c452d6486655f87bc0d417de8a6 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for b176745e20708cde79d0b687463564c4 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:55:33,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e75b9d7ba9a6a0449e6a9e5cfa114a22, disabling compactions & flushes 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 2909504afec6ba9e2c32f9b4bb85bf38 2023-10-29 16:55:33,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 4a772aadd544166a447714365edccc5d 2023-10-29 16:55:33,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 4544ad4a3a3c44ac4a93deaee27f85d1 2023-10-29 16:55:33,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. after waiting 0 ms 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 0b6e4e263d82b5dd60d683d22ce5179c 2023-10-29 16:55:33,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 5654fa8c3658e7e7b12d603407068476 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for b5b7cdd77390009e7ea5fe5db6760a39 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 2b761645cf3c2b80fb2a3dad1481d3e2 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 85653a47b2e3f679e9493cdd405920d6 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 2de4f508daf224aaf110e9ea7a56b9d5 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 611c3dca449d24c3f11e484e3de1e115 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 7c0fca5c4fcfe7c4074cd73394563f6e 2023-10-29 16:55:33,437 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for a777b792e0007c094a37fa7dd2191d3a 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for e30249e1bca8e8de96f475892eacf6d6 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 5e50272c69b19a0b5b2b49937c687b92 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for fa199e7b26b842cefa4b3d2db5685100 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:33,438 DEBUG [RS:0;jenkins-hbase20:43165] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x749237b6 to 127.0.0.1:61373 2023-10-29 16:55:33,438 DEBUG [RS:0;jenkins-hbase20:43165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-29 16:55:33,438 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-29 16:55:33,439 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-29 16:55:33,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 16:55:33,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 16:55:33,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 16:55:33,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 16:55:33,439 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 16:55:33,439 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-10-29 16:55:33,439 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 0b6e4e263d82b5dd60d683d22ce5179c, 1588230740, 2909504afec6ba9e2c32f9b4bb85bf38, 2b761645cf3c2b80fb2a3dad1481d3e2, 2de4f508daf224aaf110e9ea7a56b9d5, 4544ad4a3a3c44ac4a93deaee27f85d1, 4a772aadd544166a447714365edccc5d, 5654fa8c3658e7e7b12d603407068476, 5e50272c69b19a0b5b2b49937c687b92, 611c3dca449d24c3f11e484e3de1e115, 7c0fca5c4fcfe7c4074cd73394563f6e, 85653a47b2e3f679e9493cdd405920d6, 92187c452d6486655f87bc0d417de8a6, a777b792e0007c094a37fa7dd2191d3a, b176745e20708cde79d0b687463564c4, b5b7cdd77390009e7ea5fe5db6760a39, e30249e1bca8e8de96f475892eacf6d6, e75b9d7ba9a6a0449e6a9e5cfa114a22, fa199e7b26b842cefa4b3d2db5685100, fee1224f2bb118ba7ba19156a7ef88e1, ff824f34119091986d5f8c31d6248d2c 2023-10-29 16:55:33,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/e75b9d7ba9a6a0449e6a9e5cfa114a22/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 16:55:33,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e75b9d7ba9a6a0449e6a9e5cfa114a22: 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698598402253.e75b9d7ba9a6a0449e6a9e5cfa114a22. 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 92187c452d6486655f87bc0d417de8a6, disabling compactions & flushes 2023-10-29 16:55:33,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. after waiting 0 ms 2023-10-29 16:55:33,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:33,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithMonthlyPolicy/92187c452d6486655f87bc0d417de8a6/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 16:55:33,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 92187c452d6486655f87bc0d417de8a6: 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698598500602.92187c452d6486655f87bc0d417de8a6. 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b176745e20708cde79d0b687463564c4, disabling compactions & flushes 2023-10-29 16:55:33,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. after waiting 0 ms 2023-10-29 16:55:33,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:55:33,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithMonthlyPolicy/b176745e20708cde79d0b687463564c4/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 16:55:33,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b176745e20708cde79d0b687463564c4: 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698598380698.b176745e20708cde79d0b687463564c4. 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ff824f34119091986d5f8c31d6248d2c, disabling compactions & flushes 2023-10-29 16:55:33,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. after waiting 0 ms 2023-10-29 16:55:33,468 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:55:33,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ff824f34119091986d5f8c31d6248d2c/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 16:55:33,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ff824f34119091986d5f8c31d6248d2c: 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698598437786.ff824f34119091986d5f8c31d6248d2c. 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2909504afec6ba9e2c32f9b4bb85bf38, disabling compactions & flushes 2023-10-29 16:55:33,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. after waiting 0 ms 2023-10-29 16:55:33,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:55:33,483 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-29 16:55:33,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/2909504afec6ba9e2c32f9b4bb85bf38/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 16:55:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2909504afec6ba9e2c32f9b4bb85bf38: 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698598402253.2909504afec6ba9e2c32f9b4bb85bf38. 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4a772aadd544166a447714365edccc5d, disabling compactions & flushes 2023-10-29 16:55:33,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. after waiting 0 ms 2023-10-29 16:55:33,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:33,491 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-29 16:55:33,491 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-29 16:55:33,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/4a772aadd544166a447714365edccc5d/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:33,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4a772aadd544166a447714365edccc5d: 2023-10-29 16:55:33,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698598512380.4a772aadd544166a447714365edccc5d. 2023-10-29 16:55:33,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4544ad4a3a3c44ac4a93deaee27f85d1, disabling compactions & flushes 2023-10-29 16:55:33,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:55:33,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:55:33,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. after waiting 0 ms 2023-10-29 16:55:33,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:55:33,496 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-29 16:55:33,496 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/4544ad4a3a3c44ac4a93deaee27f85d1/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 16:55:33,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:55:33,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4544ad4a3a3c44ac4a93deaee27f85d1: 2023-10-29 16:55:33,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698598421328.4544ad4a3a3c44ac4a93deaee27f85d1. 2023-10-29 16:55:33,497 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0b6e4e263d82b5dd60d683d22ce5179c, disabling compactions & flushes 2023-10-29 16:55:33,497 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:55:33,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:55:33,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. after waiting 0 ms 2023-10-29 16:55:33,498 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:55:33,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testScannerOnBulkLoadRefHFiles/0b6e4e263d82b5dd60d683d22ce5179c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 16:55:33,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:55:33,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0b6e4e263d82b5dd60d683d22ce5179c: 2023-10-29 16:55:33,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698598402253.0b6e4e263d82b5dd60d683d22ce5179c. 2023-10-29 16:55:33,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5654fa8c3658e7e7b12d603407068476, disabling compactions & flushes 2023-10-29 16:55:33,502 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:55:33,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:55:33,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. after waiting 0 ms 2023-10-29 16:55:33,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:55:33,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/5654fa8c3658e7e7b12d603407068476/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 16:55:33,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5654fa8c3658e7e7b12d603407068476: 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698598459809.5654fa8c3658e7e7b12d603407068476. 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b5b7cdd77390009e7ea5fe5db6760a39, disabling compactions & flushes 2023-10-29 16:55:33,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. after waiting 0 ms 2023-10-29 16:55:33,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:55:33,509 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMinorCompactionWithWeeklyPolicy/b5b7cdd77390009e7ea5fe5db6760a39/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-29 16:55:33,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b5b7cdd77390009e7ea5fe5db6760a39: 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698598391754.b5b7cdd77390009e7ea5fe5db6760a39. 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2b761645cf3c2b80fb2a3dad1481d3e2, disabling compactions & flushes 2023-10-29 16:55:33,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. after waiting 0 ms 2023-10-29 16:55:33,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:55:33,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/2b761645cf3c2b80fb2a3dad1481d3e2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:55:33,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2b761645cf3c2b80fb2a3dad1481d3e2: 2023-10-29 16:55:33,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698598485205.2b761645cf3c2b80fb2a3dad1481d3e2. 2023-10-29 16:55:33,514 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 85653a47b2e3f679e9493cdd405920d6, disabling compactions & flushes 2023-10-29 16:55:33,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:55:33,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:55:33,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. after waiting 0 ms 2023-10-29 16:55:33,515 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:55:33,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/85653a47b2e3f679e9493cdd405920d6/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 16:55:33,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:55:33,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 85653a47b2e3f679e9493cdd405920d6: 2023-10-29 16:55:33,518 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698598459809.85653a47b2e3f679e9493cdd405920d6. 2023-10-29 16:55:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2de4f508daf224aaf110e9ea7a56b9d5, disabling compactions & flushes 2023-10-29 16:55:33,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:55:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:55:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. after waiting 0 ms 2023-10-29 16:55:33,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:55:33,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testCompactionWithHFileLink/2de4f508daf224aaf110e9ea7a56b9d5/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 16:55:33,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2de4f508daf224aaf110e9ea7a56b9d5: 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698598459809.2de4f508daf224aaf110e9ea7a56b9d5. 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 611c3dca449d24c3f11e484e3de1e115, disabling compactions & flushes 2023-10-29 16:55:33,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. after waiting 0 ms 2023-10-29 16:55:33,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:33,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/611c3dca449d24c3f11e484e3de1e115/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 611c3dca449d24c3f11e484e3de1e115: 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698598512380.611c3dca449d24c3f11e484e3de1e115. 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7c0fca5c4fcfe7c4074cd73394563f6e, disabling compactions & flushes 2023-10-29 16:55:33,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. after waiting 0 ms 2023-10-29 16:55:33,527 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:33,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionFromAdmin/7c0fca5c4fcfe7c4074cd73394563f6e/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7c0fca5c4fcfe7c4074cd73394563f6e: 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698598512380.7c0fca5c4fcfe7c4074cd73394563f6e. 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a777b792e0007c094a37fa7dd2191d3a, disabling compactions & flushes 2023-10-29 16:55:33,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. after waiting 0 ms 2023-10-29 16:55:33,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/a777b792e0007c094a37fa7dd2191d3a/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a777b792e0007c094a37fa7dd2191d3a: 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698598485205.a777b792e0007c094a37fa7dd2191d3a. 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e30249e1bca8e8de96f475892eacf6d6, disabling compactions & flushes 2023-10-29 16:55:33,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. after waiting 0 ms 2023-10-29 16:55:33,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:55:33,534 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e30249e1bca8e8de96f475892eacf6d6 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-29 16:55:33,640 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740, 5e50272c69b19a0b5b2b49937c687b92, e30249e1bca8e8de96f475892eacf6d6, fa199e7b26b842cefa4b3d2db5685100, fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:55:33,840 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740, 5e50272c69b19a0b5b2b49937c687b92, e30249e1bca8e8de96f475892eacf6d6, fa199e7b26b842cefa4b3d2db5685100, fee1224f2bb118ba7ba19156a7ef88e1 2023-10-29 16:55:33,863 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/info/1fcae0700e2c403594e6789386746f68 2023-10-29 16:55:33,867 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcae0700e2c403594e6789386746f68 2023-10-29 16:55:33,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/.tmp/info/255d3083daa04937ac30c59e635faf66 2023-10-29 16:55:33,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/.tmp/info/255d3083daa04937ac30c59e635faf66 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/info/255d3083daa04937ac30c59e635faf66 2023-10-29 16:55:33,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/info/255d3083daa04937ac30c59e635faf66, entries=3, sequenceid=7, filesize=4.8 K 2023-10-29 16:55:33,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e30249e1bca8e8de96f475892eacf6d6 in 415ms, sequenceid=7, compaction requested=false 2023-10-29 16:55:33,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/namespace/e30249e1bca8e8de96f475892eacf6d6/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-29 16:55:33,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e30249e1bca8e8de96f475892eacf6d6: 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698598369042.e30249e1bca8e8de96f475892eacf6d6. 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fee1224f2bb118ba7ba19156a7ef88e1, disabling compactions & flushes 2023-10-29 16:55:33,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. after waiting 0 ms 2023-10-29 16:55:33,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:55:33,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/ns/testMinorCompaction/fee1224f2bb118ba7ba19156a7ef88e1/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 16:55:33,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:55:33,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fee1224f2bb118ba7ba19156a7ef88e1: 2023-10-29 16:55:33,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698598485205.fee1224f2bb118ba7ba19156a7ef88e1. 2023-10-29 16:55:33,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5e50272c69b19a0b5b2b49937c687b92, disabling compactions & flushes 2023-10-29 16:55:33,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:55:33,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:55:33,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. after waiting 0 ms 2023-10-29 16:55:33,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5e50272c69b19a0b5b2b49937c687b92/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 16:55:33,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5e50272c69b19a0b5b2b49937c687b92: 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698598370339.5e50272c69b19a0b5b2b49937c687b92. 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fa199e7b26b842cefa4b3d2db5685100, disabling compactions & flushes 2023-10-29 16:55:33,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. after waiting 0 ms 2023-10-29 16:55:33,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:55:33,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/default/testMajorCompactionWithWeeklyPolicy/fa199e7b26b842cefa4b3d2db5685100/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 16:55:33,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:55:33,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fa199e7b26b842cefa4b3d2db5685100: 2023-10-29 16:55:33,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698598407349.fa199e7b26b842cefa4b3d2db5685100. 2023-10-29 16:55:34,040 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 16:55:34,240 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 16:55:34,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/rep_barrier/319acf99372640cd8ef1e6c5169d310f 2023-10-29 16:55:34,276 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 319acf99372640cd8ef1e6c5169d310f 2023-10-29 16:55:34,441 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-10-29 16:55:34,441 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-10-29 16:55:34,441 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 16:55:34,641 DEBUG [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 16:55:34,682 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/table/05f3d2a4692d4ff8bc5ca8b4359d9a45 2023-10-29 16:55:34,686 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05f3d2a4692d4ff8bc5ca8b4359d9a45 2023-10-29 16:55:34,687 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/info/1fcae0700e2c403594e6789386746f68 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/info/1fcae0700e2c403594e6789386746f68 2023-10-29 16:55:34,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fcae0700e2c403594e6789386746f68 2023-10-29 16:55:34,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/info/1fcae0700e2c403594e6789386746f68, entries=226, sequenceid=130, filesize=37.9 K 2023-10-29 16:55:34,695 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/rep_barrier/319acf99372640cd8ef1e6c5169d310f as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/rep_barrier/319acf99372640cd8ef1e6c5169d310f 2023-10-29 16:55:34,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 319acf99372640cd8ef1e6c5169d310f 2023-10-29 16:55:34,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/rep_barrier/319acf99372640cd8ef1e6c5169d310f, entries=1, sequenceid=130, filesize=5.0 K 2023-10-29 16:55:34,699 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/.tmp/table/05f3d2a4692d4ff8bc5ca8b4359d9a45 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/table/05f3d2a4692d4ff8bc5ca8b4359d9a45 2023-10-29 16:55:34,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05f3d2a4692d4ff8bc5ca8b4359d9a45 2023-10-29 16:55:34,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/table/05f3d2a4692d4ff8bc5ca8b4359d9a45, entries=27, sequenceid=130, filesize=6.6 K 2023-10-29 16:55:34,706 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1267ms, sequenceid=130, compaction requested=false 2023-10-29 16:55:34,710 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-29 16:55:34,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 16:55:34,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 16:55:34,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 16:55:34,711 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-29 16:55:34,841 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,43165,1698598366173; all regions closed. 2023-10-29 16:55:34,854 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/WALs/jenkins-hbase20.apache.org,43165,1698598366173/jenkins-hbase20.apache.org%2C43165%2C1698598366173.meta.1698598368773.meta not finished, retry = 0 2023-10-29 16:55:34,957 DEBUG [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/oldWALs 2023-10-29 16:55:34,957 INFO [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43165%2C1698598366173.meta:.meta(num 1698598368773) 2023-10-29 16:55:34,962 DEBUG [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/oldWALs 2023-10-29 16:55:34,962 INFO [RS:0;jenkins-hbase20:43165] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C43165%2C1698598366173:(num 1698598368654) 2023-10-29 16:55:34,962 DEBUG [RS:0;jenkins-hbase20:43165] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:34,962 INFO [RS:0;jenkins-hbase20:43165] regionserver.LeaseManager(133): Closed leases 2023-10-29 16:55:34,962 INFO [RS:0;jenkins-hbase20:43165] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-29 16:55:34,962 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 16:55:34,964 INFO [RS:0;jenkins-hbase20:43165] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:43165 2023-10-29 16:55:34,973 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,43165,1698598366173 2023-10-29 16:55:34,974 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 16:55:34,974 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 16:55:34,975 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,43165,1698598366173] 2023-10-29 16:55:34,976 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,43165,1698598366173; numProcessing=1 2023-10-29 16:55:34,976 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,43165,1698598366173 already deleted, retry=false 2023-10-29 16:55:34,976 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,43165,1698598366173 expired; onlineServers=0 2023-10-29 16:55:34,976 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,42601,1698598365195' ***** 2023-10-29 16:55:34,976 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-29 16:55:34,977 DEBUG [M:0;jenkins-hbase20:42601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2145e9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-29 16:55:34,977 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,42601,1698598365195 2023-10-29 16:55:34,977 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,42601,1698598365195; all regions closed. 2023-10-29 16:55:34,977 DEBUG [M:0;jenkins-hbase20:42601] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 16:55:34,977 DEBUG [M:0;jenkins-hbase20:42601] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-29 16:55:34,978 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-29 16:55:34,978 DEBUG [M:0;jenkins-hbase20:42601] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-29 16:55:34,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698598368299] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698598368299,5,FailOnTimeoutGroup] 2023-10-29 16:55:34,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698598368299] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698598368299,5,FailOnTimeoutGroup] 2023-10-29 16:55:34,978 INFO [M:0;jenkins-hbase20:42601] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-29 16:55:34,978 INFO [M:0;jenkins-hbase20:42601] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-29 16:55:34,978 INFO [M:0;jenkins-hbase20:42601] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-29 16:55:34,979 DEBUG [M:0;jenkins-hbase20:42601] master.HMaster(1512): Stopping service threads 2023-10-29 16:55:34,979 INFO [M:0;jenkins-hbase20:42601] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-29 16:55:34,979 ERROR [M:0;jenkins-hbase20:42601] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-29 16:55:34,979 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-29 16:55:34,979 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 16:55:34,980 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 16:55:34,980 INFO [M:0;jenkins-hbase20:42601] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-29 16:55:34,980 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-29 16:55:34,981 DEBUG [M:0;jenkins-hbase20:42601] zookeeper.ZKUtil(398): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-29 16:55:34,981 WARN [M:0;jenkins-hbase20:42601] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-29 16:55:34,981 INFO [M:0;jenkins-hbase20:42601] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-29 16:55:34,981 INFO [M:0;jenkins-hbase20:42601] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-29 16:55:34,982 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 16:55:34,982 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:55:34,982 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:55:34,982 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 16:55:34,982 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:55:34,982 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.55 KB heapSize=599.74 KB 2023-10-29 16:55:35,075 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 16:55:35,075 INFO [RS:0;jenkins-hbase20:43165] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,43165,1698598366173; zookeeper connection closed. 2023-10-29 16:55:35,075 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): regionserver:43165-0x1017e9cf5f50001, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 16:55:35,076 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4300fbd0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4300fbd0 2023-10-29 16:55:35,076 INFO [Listener at localhost/45209] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-29 16:55:35,319 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 16:55:35,391 INFO [M:0;jenkins-hbase20:42601] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.55 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8e4cf4c5fc44bebb37bc79f5b7d1a91 2023-10-29 16:55:35,393 INFO [M:0;jenkins-hbase20:42601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8e4cf4c5fc44bebb37bc79f5b7d1a91 2023-10-29 16:55:35,394 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a8e4cf4c5fc44bebb37bc79f5b7d1a91 as hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8e4cf4c5fc44bebb37bc79f5b7d1a91 2023-10-29 16:55:35,397 INFO [M:0;jenkins-hbase20:42601] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a8e4cf4c5fc44bebb37bc79f5b7d1a91 2023-10-29 16:55:35,397 INFO [M:0;jenkins-hbase20:42601] regionserver.HStore(1080): Added hdfs://localhost:42197/user/jenkins/test-data/17896ffa-2a81-2a60-4ea4-57b55984c613/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a8e4cf4c5fc44bebb37bc79f5b7d1a91, entries=123, sequenceid=1011, filesize=33.3 K 2023-10-29 16:55:35,398 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegion(2948): Finished flush of dataSize ~513.55 KB/525873, heapSize ~599.73 KB/614120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 416ms, sequenceid=1011, compaction requested=false 2023-10-29 16:55:35,398 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 16:55:35,398 DEBUG [M:0;jenkins-hbase20:42601] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 16:55:35,401 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 16:55:35,401 INFO [M:0;jenkins-hbase20:42601] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-29 16:55:35,401 INFO [M:0;jenkins-hbase20:42601] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42601 2023-10-29 16:55:35,404 DEBUG [M:0;jenkins-hbase20:42601] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,42601,1698598365195 already deleted, retry=false 2023-10-29 16:55:35,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 16:55:35,505 DEBUG [Listener at localhost/45209-EventThread] zookeeper.ZKWatcher(600): master:42601-0x1017e9cf5f50000, quorum=127.0.0.1:61373, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 16:55:35,505 INFO [M:0;jenkins-hbase20:42601] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,42601,1698598365195; zookeeper connection closed. 2023-10-29 16:55:35,507 WARN [Listener at localhost/45209] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-29 16:55:35,512 INFO [Listener at localhost/45209] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 16:55:35,518 WARN [BP-1681898648-148.251.75.209-1698598362228 heartbeating to localhost/127.0.0.1:42197] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-29 16:55:35,518 WARN [BP-1681898648-148.251.75.209-1698598362228 heartbeating to localhost/127.0.0.1:42197] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1681898648-148.251.75.209-1698598362228 (Datanode Uuid 4905a877-febc-47e0-bc06-2a942bdd6717) service to localhost/127.0.0.1:42197 2023-10-29 16:55:35,522 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/dfs/data/data1/current/BP-1681898648-148.251.75.209-1698598362228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 16:55:35,523 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/49c4be37-681a-59cb-3804-ba5a8a908775/cluster_b3a43d6a-bd36-bf0d-3059-fc11f69c2255/dfs/data/data2/current/BP-1681898648-148.251.75.209-1698598362228] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 16:55:35,549 INFO [Listener at localhost/45209] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 16:55:35,685 INFO [Listener at localhost/45209] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-29 16:55:35,766 INFO [Listener at localhost/45209] hbase.HBaseTestingUtility(1293): Minicluster is down