2023-11-08 22:52:40,700 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-08 22:52:40,908 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050 2023-11-08 22:52:40,920 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-08 22:52:40,921 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03, deleteOnExit=true 2023-11-08 22:52:40,921 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-08 22:52:40,921 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/test.cache.data in system properties and HBase conf 2023-11-08 22:52:40,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/hadoop.tmp.dir in system properties and HBase conf 2023-11-08 22:52:40,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/hadoop.log.dir in system properties and HBase conf 2023-11-08 22:52:40,922 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-08 22:52:40,923 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-08 22:52:40,923 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-08 22:52:41,026 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-08 22:52:41,368 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-08 22:52:41,372 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-08 22:52:41,372 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-08 22:52:41,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-08 22:52:41,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-08 22:52:41,373 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-08 22:52:41,374 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-08 22:52:41,374 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-08 22:52:41,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-08 22:52:41,375 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-08 22:52:41,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/nfs.dump.dir in system properties and HBase conf 2023-11-08 22:52:41,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/java.io.tmpdir in system properties and HBase conf 2023-11-08 22:52:41,376 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-08 22:52:41,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-08 22:52:41,377 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-08 22:52:41,921 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-08 22:52:41,925 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-08 22:52:42,163 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-08 22:52:42,337 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-08 22:52:42,357 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-08 22:52:42,388 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-08 22:52:42,417 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/java.io.tmpdir/Jetty_localhost_36983_hdfs____y89kkb/webapp 2023-11-08 22:52:42,533 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36983 2023-11-08 22:52:42,542 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-08 22:52:42,542 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-08 22:52:43,032 WARN [Listener at localhost/45285] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-08 22:52:43,122 WARN [Listener at localhost/45285] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-08 22:52:43,151 WARN [Listener at localhost/45285] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-08 22:52:43,158 INFO [Listener at localhost/45285] log.Slf4jLog(67): jetty-6.1.26 2023-11-08 22:52:43,163 INFO [Listener at localhost/45285] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/java.io.tmpdir/Jetty_localhost_39783_datanode____7ujos3/webapp 2023-11-08 22:52:43,251 INFO [Listener at localhost/45285] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39783 2023-11-08 22:52:43,642 WARN [Listener at localhost/37975] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-08 22:52:44,109 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d3d1201e502a852: Processing first storage report for DS-25646778-1c88-4132-9689-4706e1dd1690 from datanode b83a2e69-fd38-4d8f-af55-540546159d77 2023-11-08 22:52:44,111 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d3d1201e502a852: from storage DS-25646778-1c88-4132-9689-4706e1dd1690 node DatanodeRegistration(127.0.0.1:38891, datanodeUuid=b83a2e69-fd38-4d8f-af55-540546159d77, infoPort=40457, infoSecurePort=0, ipcPort=37975, storageInfo=lv=-57;cid=testClusterID;nsid=1823410434;c=1699483961994), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-08 22:52:44,111 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7d3d1201e502a852: Processing first storage report for DS-d5da9384-6715-4f73-8fe6-99fde18f98c6 from datanode b83a2e69-fd38-4d8f-af55-540546159d77 2023-11-08 22:52:44,112 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7d3d1201e502a852: from storage DS-d5da9384-6715-4f73-8fe6-99fde18f98c6 node DatanodeRegistration(127.0.0.1:38891, datanodeUuid=b83a2e69-fd38-4d8f-af55-540546159d77, infoPort=40457, infoSecurePort=0, ipcPort=37975, storageInfo=lv=-57;cid=testClusterID;nsid=1823410434;c=1699483961994), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-08 22:52:44,187 DEBUG [Listener at localhost/37975] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050 2023-11-08 22:52:44,299 INFO [Listener at localhost/37975] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/zookeeper_0, clientPort=56299, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-08 22:52:44,315 INFO [Listener at localhost/37975] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56299 2023-11-08 22:52:44,324 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:44,326 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:44,978 INFO [Listener at localhost/37975] util.FSUtils(471): Created version file at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e with version=8 2023-11-08 22:52:44,978 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/hbase-staging 2023-11-08 22:52:45,230 INFO [Listener at localhost/37975] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-08 22:52:45,594 INFO [Listener at localhost/37975] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-11-08 22:52:45,620 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:45,621 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:45,621 INFO [Listener at localhost/37975] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-08 22:52:45,621 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:45,621 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-08 22:52:45,746 INFO [Listener at localhost/37975] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-08 22:52:45,805 DEBUG [Listener at localhost/37975] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-08 22:52:45,882 INFO [Listener at localhost/37975] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44485 2023-11-08 22:52:45,890 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:45,892 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:45,911 INFO [Listener at localhost/37975] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44485 connecting to ZooKeeper ensemble=127.0.0.1:56299 2023-11-08 22:52:45,955 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:444850x0, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-08 22:52:45,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44485-0x101b36624920000 connected 2023-11-08 22:52:46,051 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-08 22:52:46,052 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-08 22:52:46,056 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-08 22:52:46,062 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44485 2023-11-08 22:52:46,063 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44485 2023-11-08 22:52:46,063 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44485 2023-11-08 22:52:46,063 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44485 2023-11-08 22:52:46,064 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44485 2023-11-08 22:52:46,069 INFO [Listener at localhost/37975] master.HMaster(444): hbase.rootdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e, hbase.cluster.distributed=false 2023-11-08 22:52:46,134 INFO [Listener at localhost/37975] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-11-08 22:52:46,134 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:46,135 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:46,135 INFO [Listener at localhost/37975] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-08 22:52:46,135 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-08 22:52:46,135 INFO [Listener at localhost/37975] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-08 22:52:46,139 INFO [Listener at localhost/37975] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-08 22:52:46,142 INFO [Listener at localhost/37975] ipc.NettyRpcServer(120): Bind to /148.251.75.209:35543 2023-11-08 22:52:46,144 INFO [Listener at localhost/37975] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-08 22:52:46,149 DEBUG [Listener at localhost/37975] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-08 22:52:46,150 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:46,153 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:46,155 INFO [Listener at localhost/37975] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35543 connecting to ZooKeeper ensemble=127.0.0.1:56299 2023-11-08 22:52:46,158 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:355430x0, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-08 22:52:46,159 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35543-0x101b36624920001 connected 2023-11-08 22:52:46,160 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-08 22:52:46,161 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-08 22:52:46,162 DEBUG [Listener at localhost/37975] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-08 22:52:46,162 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35543 2023-11-08 22:52:46,163 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35543 2023-11-08 22:52:46,163 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35543 2023-11-08 22:52:46,164 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35543 2023-11-08 22:52:46,164 DEBUG [Listener at localhost/37975] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35543 2023-11-08 22:52:46,166 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:46,175 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-08 22:52:46,177 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:46,193 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-08 22:52:46,193 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-08 22:52:46,193 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:46,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-08 22:52:46,196 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,44485,1699483965103 from backup master directory 2023-11-08 22:52:46,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-08 22:52:46,199 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:46,199 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-08 22:52:46,200 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-08 22:52:46,201 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:46,203 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-08 22:52:46,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-08 22:52:46,824 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/hbase.id with ID: 340d6ad9-c913-47b1-b7c2-39730a859357 2023-11-08 22:52:46,879 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:47,102 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:47,147 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x307eb289 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:52:47,179 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52ff9ddf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:52:47,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-08 22:52:47,206 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-08 22:52:47,220 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-08 22:52:47,220 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-08 22:52:47,222 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-08 22:52:47,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-08 22:52:47,228 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-08 22:52:47,265 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store-tmp 2023-11-08 22:52:47,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:47,691 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-08 22:52:47,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:52:47,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:52:47,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-08 22:52:47,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:52:47,692 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:52:47,692 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-08 22:52:47,694 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/WALs/jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:47,718 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44485%2C1699483965103, suffix=, logDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/WALs/jenkins-hbase20.apache.org,44485,1699483965103, archiveDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/oldWALs, maxLogs=10 2023-11-08 22:52:47,774 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK] 2023-11-08 22:52:47,781 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-08 22:52:47,843 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/WALs/jenkins-hbase20.apache.org,44485,1699483965103/jenkins-hbase20.apache.org%2C44485%2C1699483965103.1699483967727 2023-11-08 22:52:47,845 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK]] 2023-11-08 22:52:47,845 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:52:47,846 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:47,849 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:47,851 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:47,920 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:47,928 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-08 22:52:47,959 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-08 22:52:47,974 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:47,981 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:47,983 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:47,999 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-08 22:52:48,008 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:52:48,009 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60059701, jitterRate=-0.10504071414470673}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:52:48,009 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-08 22:52:48,010 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-08 22:52:48,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-08 22:52:48,035 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-08 22:52:48,039 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-08 22:52:48,041 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-11-08 22:52:48,073 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 32 msec 2023-11-08 22:52:48,073 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-08 22:52:48,098 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-08 22:52:48,104 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-08 22:52:48,125 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-08 22:52:48,130 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-08 22:52:48,133 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-08 22:52:48,139 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-08 22:52:48,144 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-08 22:52:48,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:48,148 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-08 22:52:48,149 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-08 22:52:48,165 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-08 22:52:48,173 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-08 22:52:48,173 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-08 22:52:48,173 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:48,174 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,44485,1699483965103, sessionid=0x101b36624920000, setting cluster-up flag (Was=false) 2023-11-08 22:52:48,190 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:48,194 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-08 22:52:48,196 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:48,200 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:48,204 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-08 22:52:48,206 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:48,208 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp 2023-11-08 22:52:48,271 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(951): ClusterId : 340d6ad9-c913-47b1-b7c2-39730a859357 2023-11-08 22:52:48,276 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-08 22:52:48,282 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-08 22:52:48,283 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-08 22:52:48,286 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-08 22:52:48,288 DEBUG [RS:0;jenkins-hbase20:35543] zookeeper.ReadOnlyZKClient(139): Connect 0x082b9ab9 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:52:48,306 DEBUG [RS:0;jenkins-hbase20:35543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6ec75cc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:52:48,307 DEBUG [RS:0;jenkins-hbase20:35543] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d3f1c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-08 22:52:48,332 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:35543 2023-11-08 22:52:48,336 INFO [RS:0;jenkins-hbase20:35543] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-08 22:52:48,336 INFO [RS:0;jenkins-hbase20:35543] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-08 22:52:48,336 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1022): About to register with Master. 2023-11-08 22:52:48,339 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,44485,1699483965103 with isa=jenkins-hbase20.apache.org/148.251.75.209:35543, startcode=1699483966133 2023-11-08 22:52:48,346 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-08 22:52:48,358 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-08 22:52:48,359 DEBUG [RS:0;jenkins-hbase20:35543] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-08 22:52:48,359 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1699483998377 2023-11-08 22:52:48,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-08 22:52:48,381 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-08 22:52:48,381 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-08 22:52:48,397 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-08 22:52:48,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-08 22:52:48,408 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-08 22:52:48,409 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-08 22:52:48,409 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-08 22:52:48,409 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-08 22:52:48,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,412 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-08 22:52:48,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-08 22:52:48,414 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-08 22:52:48,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-08 22:52:48,418 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-08 22:52:48,422 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699483968420,5,FailOnTimeoutGroup] 2023-11-08 22:52:48,427 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699483968426,5,FailOnTimeoutGroup] 2023-11-08 22:52:48,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-08 22:52:48,432 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,433 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,443 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44929, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-08 22:52:48,446 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-08 22:52:48,447 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-08 22:52:48,448 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e 2023-11-08 22:52:48,460 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44485] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,468 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:48,476 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-08 22:52:48,483 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e 2023-11-08 22:52:48,483 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:45285 2023-11-08 22:52:48,483 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-11-08 22:52:48,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/info 2023-11-08 22:52:48,487 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-08 22:52:48,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:48,489 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-08 22:52:48,492 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/rep_barrier 2023-11-08 22:52:48,493 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-08 22:52:48,493 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:48,494 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-08 22:52:48,496 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/table 2023-11-08 22:52:48,497 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-08 22:52:48,498 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-08 22:52:48,500 DEBUG [RS:0;jenkins-hbase20:35543] zookeeper.ZKUtil(162): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,499 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:48,501 WARN [RS:0;jenkins-hbase20:35543] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-08 22:52:48,502 INFO [RS:0;jenkins-hbase20:35543] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-08 22:52:48,502 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1948): logDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/WALs/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,505 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740 2023-11-08 22:52:48,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,35543,1699483966133] 2023-11-08 22:52:48,511 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740 2023-11-08 22:52:48,518 DEBUG [RS:0;jenkins-hbase20:35543] zookeeper.ZKUtil(162): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,518 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-08 22:52:48,521 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-08 22:52:48,525 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:52:48,531 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59454011, jitterRate=-0.11406619846820831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-08 22:52:48,531 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-08 22:52:48,531 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-08 22:52:48,531 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-08 22:52:48,531 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-08 22:52:48,532 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-08 22:52:48,532 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-08 22:52:48,532 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-08 22:52:48,533 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-08 22:52:48,533 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-08 22:52:48,539 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-08 22:52:48,539 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-08 22:52:48,542 INFO [RS:0;jenkins-hbase20:35543] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-08 22:52:48,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-08 22:52:48,564 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-08 22:52:48,566 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-08 22:52:48,568 INFO [RS:0;jenkins-hbase20:35543] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-08 22:52:48,572 INFO [RS:0;jenkins-hbase20:35543] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:52:48,573 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,579 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-11-08 22:52:48,588 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,588 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,589 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,589 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,589 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,590 DEBUG [RS:0;jenkins-hbase20:35543] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-11-08 22:52:48,594 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,595 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,595 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,612 INFO [RS:0;jenkins-hbase20:35543] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-08 22:52:48,614 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,35543,1699483966133-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:48,631 INFO [RS:0;jenkins-hbase20:35543] regionserver.Replication(203): jenkins-hbase20.apache.org,35543,1699483966133 started 2023-11-08 22:52:48,631 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,35543,1699483966133, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:35543, sessionid=0x101b36624920001 2023-11-08 22:52:48,631 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-08 22:52:48,632 DEBUG [RS:0;jenkins-hbase20:35543] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,632 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35543,1699483966133' 2023-11-08 22:52:48,632 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:48,632 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:48,633 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-08 22:52:48,633 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-08 22:52:48,633 DEBUG [RS:0;jenkins-hbase20:35543] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,633 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,35543,1699483966133' 2023-11-08 22:52:48,633 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-08 22:52:48,634 DEBUG [RS:0;jenkins-hbase20:35543] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-08 22:52:48,634 DEBUG [RS:0;jenkins-hbase20:35543] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-08 22:52:48,635 INFO [RS:0;jenkins-hbase20:35543] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-08 22:52:48,635 INFO [RS:0;jenkins-hbase20:35543] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-08 22:52:48,718 DEBUG [jenkins-hbase20:44485] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-08 22:52:48,721 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35543,1699483966133, state=OPENING 2023-11-08 22:52:48,730 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-08 22:52:48,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:48,732 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-08 22:52:48,736 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:52:48,746 INFO [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35543%2C1699483966133, suffix=, logDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/WALs/jenkins-hbase20.apache.org,35543,1699483966133, archiveDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/oldWALs, maxLogs=32 2023-11-08 22:52:48,771 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK] 2023-11-08 22:52:48,784 INFO [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/WALs/jenkins-hbase20.apache.org,35543,1699483966133/jenkins-hbase20.apache.org%2C35543%2C1699483966133.1699483968751 2023-11-08 22:52:48,785 DEBUG [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK]] 2023-11-08 22:52:48,924 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:48,926 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-08 22:52:48,930 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47006, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-08 22:52:48,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-08 22:52:48,940 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-08 22:52:48,944 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C35543%2C1699483966133.meta, suffix=.meta, logDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/WALs/jenkins-hbase20.apache.org,35543,1699483966133, archiveDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/oldWALs, maxLogs=32 2023-11-08 22:52:48,961 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK] 2023-11-08 22:52:48,972 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/WALs/jenkins-hbase20.apache.org,35543,1699483966133/jenkins-hbase20.apache.org%2C35543%2C1699483966133.meta.1699483968946.meta 2023-11-08 22:52:48,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38891,DS-25646778-1c88-4132-9689-4706e1dd1690,DISK]] 2023-11-08 22:52:48,972 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:52:48,974 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-08 22:52:48,991 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-08 22:52:48,997 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-08 22:52:49,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-08 22:52:49,003 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:49,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-08 22:52:49,004 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-08 22:52:49,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-08 22:52:49,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/info 2023-11-08 22:52:49,018 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/info 2023-11-08 22:52:49,018 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-08 22:52:49,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:49,020 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-08 22:52:49,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/rep_barrier 2023-11-08 22:52:49,022 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/rep_barrier 2023-11-08 22:52:49,023 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-08 22:52:49,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:49,025 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-08 22:52:49,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/table 2023-11-08 22:52:49,027 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/table 2023-11-08 22:52:49,028 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-08 22:52:49,028 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:49,030 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740 2023-11-08 22:52:49,033 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740 2023-11-08 22:52:49,037 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-08 22:52:49,040 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-08 22:52:49,041 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63061023, jitterRate=-0.06031753122806549}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-08 22:52:49,042 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-08 22:52:49,051 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1699483968918 2023-11-08 22:52:49,069 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-08 22:52:49,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-08 22:52:49,070 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,35543,1699483966133, state=OPEN 2023-11-08 22:52:49,074 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-08 22:52:49,074 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-08 22:52:49,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-11-08 22:52:49,080 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,35543,1699483966133 in 338 msec 2023-11-08 22:52:49,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-11-08 22:52:49,087 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 534 msec 2023-11-08 22:52:49,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 826 msec 2023-11-08 22:52:49,094 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1699483969094, completionTime=-1 2023-11-08 22:52:49,094 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-08 22:52:49,095 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-08 22:52:49,152 DEBUG [hconnection-0x5a7a86df-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:52:49,156 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:52:49,177 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-08 22:52:49,177 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1699484029177 2023-11-08 22:52:49,177 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1699484089177 2023-11-08 22:52:49,177 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 82 msec 2023-11-08 22:52:49,210 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44485,1699483965103-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:49,211 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44485,1699483965103-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:49,211 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44485,1699483965103-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:49,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:44485, period=300000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:49,213 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-08 22:52:49,226 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-08 22:52:49,228 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-08 22:52:49,229 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-08 22:52:49,241 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-08 22:52:49,244 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:52:49,247 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:52:49,271 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:49,273 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482 empty. 2023-11-08 22:52:49,274 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:49,274 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-08 22:52:49,701 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-08 22:52:49,705 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2d4708da225b5f7624a58deccfe86482, NAME => 'hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:52:49,728 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:49,728 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 2d4708da225b5f7624a58deccfe86482, disabling compactions & flushes 2023-11-08 22:52:49,728 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:49,728 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:49,729 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. after waiting 0 ms 2023-11-08 22:52:49,729 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:49,729 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:49,729 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 2d4708da225b5f7624a58deccfe86482: 2023-11-08 22:52:49,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:52:49,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699483969739"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699483969739"}]},"ts":"1699483969739"} 2023-11-08 22:52:49,773 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:52:49,775 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:52:49,780 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483969776"}]},"ts":"1699483969776"} 2023-11-08 22:52:49,784 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-08 22:52:49,790 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2d4708da225b5f7624a58deccfe86482, ASSIGN}] 2023-11-08 22:52:49,794 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=2d4708da225b5f7624a58deccfe86482, ASSIGN 2023-11-08 22:52:49,795 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=2d4708da225b5f7624a58deccfe86482, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:52:49,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2d4708da225b5f7624a58deccfe86482, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:49,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699483969946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483969946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483969946"}]},"ts":"1699483969946"} 2023-11-08 22:52:49,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 2d4708da225b5f7624a58deccfe86482, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:52:50,109 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:50,116 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:50,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d4708da225b5f7624a58deccfe86482, NAME => 'hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:52:50,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:50,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,121 INFO [StoreOpener-2d4708da225b5f7624a58deccfe86482-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,123 DEBUG [StoreOpener-2d4708da225b5f7624a58deccfe86482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/info 2023-11-08 22:52:50,124 DEBUG [StoreOpener-2d4708da225b5f7624a58deccfe86482-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/info 2023-11-08 22:52:50,124 INFO [StoreOpener-2d4708da225b5f7624a58deccfe86482-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d4708da225b5f7624a58deccfe86482 columnFamilyName info 2023-11-08 22:52:50,125 INFO [StoreOpener-2d4708da225b5f7624a58deccfe86482-1] regionserver.HStore(310): Store=2d4708da225b5f7624a58deccfe86482/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:50,127 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,132 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:52:50,145 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:52:50,146 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2d4708da225b5f7624a58deccfe86482; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69347737, jitterRate=0.033361807465553284}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:52:50,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2d4708da225b5f7624a58deccfe86482: 2023-11-08 22:52:50,149 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482., pid=6, masterSystemTime=1699483970109 2023-11-08 22:52:50,154 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:50,154 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:52:50,156 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=2d4708da225b5f7624a58deccfe86482, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:50,157 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1699483970155"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699483970155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699483970155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699483970155"}]},"ts":"1699483970155"} 2023-11-08 22:52:50,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-11-08 22:52:50,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 2d4708da225b5f7624a58deccfe86482, server=jenkins-hbase20.apache.org,35543,1699483966133 in 208 msec 2023-11-08 22:52:50,172 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-11-08 22:52:50,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=2d4708da225b5f7624a58deccfe86482, ASSIGN in 377 msec 2023-11-08 22:52:50,174 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:52:50,175 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483970175"}]},"ts":"1699483970175"} 2023-11-08 22:52:50,178 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-08 22:52:50,182 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:52:50,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 951 msec 2023-11-08 22:52:50,245 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-08 22:52:50,246 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-08 22:52:50,247 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:52:50,291 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-08 22:52:50,309 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-08 22:52:50,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-11-08 22:52:50,326 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-08 22:52:50,342 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-08 22:52:50,349 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-11-08 22:52:50,363 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-08 22:52:50,365 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-08 22:52:50,365 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.164sec 2023-11-08 22:52:50,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-08 22:52:50,369 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-08 22:52:50,369 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-08 22:52:50,370 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44485,1699483965103-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-08 22:52:50,371 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44485,1699483965103-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-08 22:52:50,379 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(139): Connect 0x405f6c92 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:52:50,390 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-08 22:52:50,390 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@293476f7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:52:50,408 DEBUG [hconnection-0x1d420dc3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:52:50,419 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:52:50,427 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:52:50,429 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(139): Connect 0x76c5615e to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:52:50,433 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1358a1f3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:52:50,433 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:52:50,486 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=170, AvailableMemoryMB=6885 2023-11-08 22:52:50,499 DEBUG [Listener at localhost/37975] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:52:50,502 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:52:50,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:52:50,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:50,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:52:50,521 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:52:50,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-08 22:52:50,524 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:50,525 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 empty. 2023-11-08 22:52:50,527 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:50,527 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-08 22:52:50,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-08 22:52:50,543 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-08 22:52:50,545 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 208b1a13f3708f44bc309e7e19d8ee64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:52:50,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-08 22:52:50,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 208b1a13f3708f44bc309e7e19d8ee64, disabling compactions & flushes 2023-11-08 22:52:50,958 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. after waiting 0 ms 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:50,958 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:50,958 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:50,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:52:50,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483970964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699483970964"}]},"ts":"1699483970964"} 2023-11-08 22:52:50,968 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:52:50,970 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:52:50,970 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483970970"}]},"ts":"1699483970970"} 2023-11-08 22:52:50,972 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-08 22:52:50,975 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, ASSIGN}] 2023-11-08 22:52:50,978 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, ASSIGN 2023-11-08 22:52:50,980 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:52:51,131 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:51,132 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483971131"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483971131"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483971131"}]},"ts":"1699483971131"} 2023-11-08 22:52:51,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:52:51,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-08 22:52:51,290 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:51,297 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 208b1a13f3708f44bc309e7e19d8ee64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:52:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:52:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,303 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,306 DEBUG [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:52:51,306 DEBUG [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:52:51,309 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 208b1a13f3708f44bc309e7e19d8ee64 columnFamilyName family1 2023-11-08 22:52:51,313 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] regionserver.HStore(310): Store=208b1a13f3708f44bc309e7e19d8ee64/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:52:51,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:52:51,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:52:51,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 208b1a13f3708f44bc309e7e19d8ee64; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72735703, jitterRate=0.08384643495082855}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:52:51,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:51,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., pid=11, masterSystemTime=1699483971290 2023-11-08 22:52:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:51,340 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:51,341 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:51,342 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483971341"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699483971341"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699483971341"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699483971341"}]},"ts":"1699483971341"} 2023-11-08 22:52:51,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-11-08 22:52:51,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133 in 218 msec 2023-11-08 22:52:51,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-11-08 22:52:51,364 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, ASSIGN in 383 msec 2023-11-08 22:52:51,366 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:52:51,366 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483971366"}]},"ts":"1699483971366"} 2023-11-08 22:52:51,369 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-08 22:52:51,372 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:52:51,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 859 msec 2023-11-08 22:52:51,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-08 22:52:51,653 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-08 22:52:51,671 DEBUG [hconnection-0x3f5c2a2a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:52:51,674 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47026, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:52:51,809 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:51,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,815 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:51,815 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:51,816 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:51,816 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:51,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,818 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:51,818 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:51,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:51,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:51,819 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:51,819 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:51,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:51,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,821 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,822 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:51,822 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:51,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:51,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:51,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:51,824 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:51,824 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:51,824 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:51,825 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:52:52,360 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130016dd52f6f474f0185b7cab311054648 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130016dd52f6f474f0185b7cab311054648 2023-11-08 22:52:52,775 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/c1b40c6c569145059faca81ef834f786 2023-11-08 22:52:52,786 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/c1b40c6c569145059faca81ef834f786 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786 2023-11-08 22:52:52,794 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-08 22:52:52,797 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 972ms, sequenceid=5, compaction requested=false 2023-11-08 22:52:52,798 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:52,801 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:52,801 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:52,801 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:52,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:52,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:52,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:52,804 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,804 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:52,806 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,806 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:52,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:52,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:52,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e85d34d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:52,809 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:52,809 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,824 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,824 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:52,824 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:52,824 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:52,825 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,825 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:52,827 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,827 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:52,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:52,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:52,827 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:52,828 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:52,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:52,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:52,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:52,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:52,837 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:52,837 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:52,837 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:52,837 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,837 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:52,842 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,842 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:52,843 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:52,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:52,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:52,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:52,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:52,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:52,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:52,857 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,858 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,858 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,858 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:52,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:52,858 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:52,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:52,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:52,860 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:52,860 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:52,961 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:52,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:52,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:52,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:52,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,985 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:52,985 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:52,986 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:52,986 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:52,987 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,987 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,991 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:52,991 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,991 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:52,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:52,992 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:52,992 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:52,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:52,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,994 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:52,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:52,994 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:52,994 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:52,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:52,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:52,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:52,995 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:52,995 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:52,995 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:52:53,426 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112873d5f22632a741b4ab6ab60c31d155b6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112873d5f22632a741b4ab6ab60c31d155b6 2023-11-08 22:52:53,439 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/d8e72b1fed1945f19443bcc20f26969a 2023-11-08 22:52:53,449 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/d8e72b1fed1945f19443bcc20f26969a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a 2023-11-08 22:52:53,458 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:52:53,460 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 465ms, sequenceid=9, compaction requested=false 2023-11-08 22:52:53,460 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:53,460 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:53,460 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:53,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:53,463 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:53,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:53,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:53,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ae5e2ba[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:53,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:53,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,467 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:53,467 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:53,467 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,467 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:53,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:53,469 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:53,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:53,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:53,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:53,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:53,474 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:53,474 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:53,474 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:53,474 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,474 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:53,476 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,476 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:53,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,476 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:53,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:53,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,478 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:53,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,483 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:53,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:53,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:53,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:53,492 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:53,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:53,492 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:53,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:53,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:53,493 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:53,493 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:53,593 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:53,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:53,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:53,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:53,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,606 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:53,606 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:53,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:53,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:53,608 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,608 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,609 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:53,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:53,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:53,610 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:53,610 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:53,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:53,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,611 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:53,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:53,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:53,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:53,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:53,612 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:53,612 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:53,612 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:54,041 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bc2fcc2a94584e2581e9340fb5e7bdf5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc2fcc2a94584e2581e9340fb5e7bdf5 2023-11-08 22:52:54,057 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/0cf828cec1fd47a4af6b87298b27efd2 2023-11-08 22:52:54,067 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/0cf828cec1fd47a4af6b87298b27efd2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2 2023-11-08 22:52:54,076 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2, entries=1, sequenceid=13, filesize=5.0 K 2023-11-08 22:52:54,077 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 465ms, sequenceid=13, compaction requested=true 2023-11-08 22:52:54,078 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:54,078 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:54,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:54,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:54,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:54,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:54,080 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,080 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:54,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:54,083 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c139c5b[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:54,083 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:54,083 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,084 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,084 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:54,084 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:54,084 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:54,084 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,085 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:54,086 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:54,086 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,086 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:54,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,086 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:54,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:54,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:54,090 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:54,090 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:54,090 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:54,090 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,091 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:54,099 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,099 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,099 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:54,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:54,100 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,102 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,107 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:54,107 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:54,107 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,108 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:54,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:54,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:54,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-08 22:52:54,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:54,108 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:54,108 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:54,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:54,109 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:54,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:54,209 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:54,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:54,220 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:54,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:54,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,223 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:54,223 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:54,223 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:54,223 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:54,224 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,224 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,225 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:54,225 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:54,226 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,226 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:54,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:54,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,227 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:54,227 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:54,228 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:54,228 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:54,228 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:54,228 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:54,228 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:54,228 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:54,526 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:52:54,593 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-08 22:52:54,594 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-08 22:52:54,659 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120593441f90c4c4425a84d8211a90e36d27 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120593441f90c4c4425a84d8211a90e36d27 2023-11-08 22:52:54,672 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/687cec13a43044eb9b38fa25725166bd 2023-11-08 22:52:54,683 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/687cec13a43044eb9b38fa25725166bd as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd 2023-11-08 22:52:54,695 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd, entries=1, sequenceid=17, filesize=5.0 K 2023-11-08 22:52:54,697 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 469ms, sequenceid=17, compaction requested=true 2023-11-08 22:52:54,697 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:54,697 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:54,697 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:54,699 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:54,699 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,699 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:54,699 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:54,704 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,705 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:54,707 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:54,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e49350d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:54,707 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,708 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,709 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:54,709 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:54,709 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:54,709 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,709 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:54,710 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:54,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:54,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:54,722 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:54,722 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:54,722 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:54,722 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,722 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:54,725 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,725 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:54,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,725 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:54,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:54,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:54,726 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:54,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:54,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:54,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:54,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:54,733 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:54,733 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:54,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:54,733 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,733 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,734 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:54,734 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:54,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:54,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:54,834 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:54,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:54,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:54,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,848 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:54,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:54,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:54,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:54,850 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,850 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,851 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:54,851 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:54,851 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:54,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,851 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:54,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:54,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,852 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,852 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:54,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:54,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:54,853 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:54,853 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:54,853 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:54,853 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:54,853 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:54,853 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:54,853 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:55,227 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-08 22:52:55,227 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-08 22:52:55,281 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280b3794aa63a24847903c103aa90e8db5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280b3794aa63a24847903c103aa90e8db5 2023-11-08 22:52:55,695 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/3c9e5f7c9e7e468b983579eb9eee40b7 2023-11-08 22:52:55,705 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/3c9e5f7c9e7e468b983579eb9eee40b7 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7 2023-11-08 22:52:55,716 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7, entries=1, sequenceid=21, filesize=5.0 K 2023-11-08 22:52:55,717 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 864ms, sequenceid=21, compaction requested=true 2023-11-08 22:52:55,717 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:55,717 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:55,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:55,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:55,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:55,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:55,721 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,722 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:55,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ec68e32[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:55,724 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:55,725 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,732 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:55,732 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:55,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,733 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:55,733 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:55,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:55,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:55,738 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:55,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:55,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:55,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,738 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:55,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,741 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,741 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:55,742 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,744 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:55,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:55,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:55,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:55,749 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:55,749 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:55,750 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,751 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:55,751 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,751 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:55,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:55,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:55,851 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:55,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:55,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:55,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:55,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,867 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:55,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:55,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:55,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:55,869 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,869 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,870 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,870 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:55,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:55,870 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,870 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:55,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:55,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,871 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,872 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:55,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,872 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:55,872 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:55,872 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:55,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:55,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:55,873 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:55,873 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:55,873 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:55,903 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319348141333bc41578c56325dc48f5d3c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319348141333bc41578c56325dc48f5d3c 2023-11-08 22:52:55,923 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/108a9a96ab2144b19f0680d2629a5eac 2023-11-08 22:52:55,938 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/108a9a96ab2144b19f0680d2629a5eac as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac 2023-11-08 22:52:55,949 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac, entries=1, sequenceid=25, filesize=5.0 K 2023-11-08 22:52:55,951 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 78ms, sequenceid=25, compaction requested=true 2023-11-08 22:52:55,951 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:55,951 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:55,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:55,952 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:55,954 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,954 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,955 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,955 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ba34162[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:55,957 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:55,957 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,958 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:55,959 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,959 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:55,959 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:55,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:55,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:55,961 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:55,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:55,966 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:55,966 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:55,966 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:55,966 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:55,966 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,966 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:55,974 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,974 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:55,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,974 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:55,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:55,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:55,976 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:55,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,977 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,982 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,982 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,983 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:55,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:55,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:55,983 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:55,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-08 22:52:55,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:55,984 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:55,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:55,984 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:55,984 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:55,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:55,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:56,084 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:56,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:56,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:56,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:56,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,102 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:56,102 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:56,103 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:56,103 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:56,103 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,103 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,106 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,106 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:56,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:56,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:56,107 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,107 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:56,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:56,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,109 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,109 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:56,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,109 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:56,109 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:56,110 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:56,110 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:56,110 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:56,110 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:56,110 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:56,110 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:56,549 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101ed4fd8dd26fe4077b036855c0645bbc3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed4fd8dd26fe4077b036855c0645bbc3 2023-11-08 22:52:56,567 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/b637035014294678bee40442e8e5079d 2023-11-08 22:52:56,579 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/b637035014294678bee40442e8e5079d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d 2023-11-08 22:52:56,591 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d, entries=1, sequenceid=29, filesize=5.0 K 2023-11-08 22:52:56,593 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 483ms, sequenceid=29, compaction requested=true 2023-11-08 22:52:56,593 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:56,593 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:56,593 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:56,594 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:56,594 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,594 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:56,594 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:56,596 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,596 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:56,597 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,597 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:56,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:56,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:56,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b72eb09[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:56,599 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:56,599 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,600 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:56,601 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:56,601 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,601 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:56,603 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:56,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:56,604 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:56,609 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:56,609 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:56,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:56,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:56,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,609 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:56,624 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,624 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:56,624 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:56,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:56,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:56,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,627 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:56,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,634 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:56,634 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:56,634 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,634 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-08 22:52:56,634 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:56,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:56,635 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:56,635 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:56,736 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:56,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:56,747 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:56,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,750 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:56,750 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:56,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:56,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:56,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,753 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:56,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:56,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:56,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:56,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:56,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:56,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:56,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:56,755 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:56,755 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:56,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:56,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:56,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:56,756 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:56,756 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:56,756 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:57,190 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b21b801ca6f74eaf83f1d643a6e50ffe to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b21b801ca6f74eaf83f1d643a6e50ffe 2023-11-08 22:52:57,203 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/097e08cfaa18451195864fecec6c8f62 2023-11-08 22:52:57,214 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/097e08cfaa18451195864fecec6c8f62 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62 2023-11-08 22:52:57,231 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62, entries=1, sequenceid=33, filesize=5.0 K 2023-11-08 22:52:57,232 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 476ms, sequenceid=33, compaction requested=true 2023-11-08 22:52:57,232 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:57,232 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:57,232 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:57,233 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:57,233 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,233 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:57,233 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:57,235 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,235 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,236 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,236 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:57,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c244c37[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:57,238 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:57,238 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,240 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,240 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:57,242 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,242 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:57,242 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:57,242 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:57,244 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:57,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:57,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:57,244 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:57,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:57,250 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:57,250 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:57,250 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:57,250 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,250 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:57,253 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,253 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,253 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:57,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:57,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:57,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,255 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,261 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,262 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,262 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:57,262 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:57,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:57,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:57,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:57,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:57,263 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:57,263 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:57,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:57,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:57,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:57,363 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:57,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:57,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:57,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:57,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,380 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:57,380 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:57,381 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:57,381 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:57,381 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,382 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,383 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:57,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:57,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:57,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:57,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:57,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,388 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,388 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:57,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:57,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:57,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:57,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:57,391 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:57,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:57,391 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:57,392 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:57,475 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077371da2694294359b3266a3d48d94cda to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509077371da2694294359b3266a3d48d94cda 2023-11-08 22:52:57,501 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/a371fa984c124bf3babdb64c9dad9c00 2023-11-08 22:52:57,514 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/a371fa984c124bf3babdb64c9dad9c00 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00 2023-11-08 22:52:57,524 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00, entries=1, sequenceid=37, filesize=5.0 K 2023-11-08 22:52:57,526 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 134ms, sequenceid=37, compaction requested=true 2023-11-08 22:52:57,526 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:57,526 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:57,526 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:57,527 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:57,527 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,527 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:57,527 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:57,529 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:57,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36c9e89f[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:57,532 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:57,532 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,533 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:57,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:57,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:57,534 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,534 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:57,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:57,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:57,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:57,536 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:57,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:57,540 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:57,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:57,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:57,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,540 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:57,545 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,545 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:57,545 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:57,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:57,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:57,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:57,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,548 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,551 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:57,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:57,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:57,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:57,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:57,559 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:57,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:57,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:57,560 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:57,560 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:57,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:57,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:57,660 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:57,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:57,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:52:57,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-08 22:52:57,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,674 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:57,674 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:57,674 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-08 22:52:57,674 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-08 22:52:57,675 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,675 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,677 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:57,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:57,677 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:57,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,678 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:57,678 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:52:57,679 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:52:57,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,679 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,680 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-08 22:52:57,680 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:57,680 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-08 22:52:57,680 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:52:57,681 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-08 22:52:57,682 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:52:57,682 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:52:57,682 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:57,682 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. started... 2023-11-08 22:52:57,682 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 208b1a13f3708f44bc309e7e19d8ee64 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:52:57,733 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112042d5a4249cee4fb59e105ed11e7a9dde to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042d5a4249cee4fb59e105ed11e7a9dde 2023-11-08 22:52:58,159 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/14696de964314465a7cbf5047b7690ec 2023-11-08 22:52:58,179 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/14696de964314465a7cbf5047b7690ec as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec 2023-11-08 22:52:58,191 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec, entries=1, sequenceid=41, filesize=5.0 K 2023-11-08 22:52:58,193 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 208b1a13f3708f44bc309e7e19d8ee64 in 511ms, sequenceid=41, compaction requested=true 2023-11-08 22:52:58,194 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:58,194 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:58,194 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:52:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:52:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-08 22:52:58,195 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-08 22:52:58,197 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:58,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:58,198 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:58,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,199 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,199 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:52:58,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:58,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-08 22:52:58,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@57801775[Count = 0] remaining members to acquire global barrier 2023-11-08 22:52:58,200 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-08 22:52:58,201 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,202 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-08 22:52:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-08 22:52:58,202 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:52:58,203 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,203 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:52:58,203 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-08 22:52:58,204 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:58,204 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-08 22:52:58,206 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:58,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:52:58,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-08 22:52:58,210 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-08 22:52:58,210 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:52:58,211 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:52:58,211 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,211 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:52:58,216 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,216 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,216 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:52:58,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:52:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:52:58,217 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:52:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,219 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:52:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,224 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:52:58,224 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:52:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:52:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:52:58,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:52:58,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:52:58,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-08 22:52:58,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:52:58,226 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-08 22:52:58,227 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:52:58,226 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,227 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,227 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,327 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:52:58,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:52:58,335 DEBUG [Listener at localhost/37975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-08 22:52:58,338 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-08 22:52:58,340 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:52:58,373 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:52:58,374 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:52:58,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:52:58,383 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484578383 2023-11-08 22:52:58,384 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:52:58,389 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-08 22:52:58,389 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:52:58,391 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x3d413525 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:52:58,415 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d68a550, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:52:58,430 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,435 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035305b776685b418da8b2f6885c30bcab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601035305b776685b418da8b2f6885c30bcab 2023-11-08 22:52:59,437 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:52:59,458 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:52:59,460 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:52:59,472 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:52:59,474 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:52:59,510 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208c1709ee994b97956cc084f8b51cf3 first=Optional[r3] last=Optional[r6] 2023-11-08 22:52:59,522 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208c1709ee994b97956cc084f8b51cf3}] 2023-11-08 22:52:59,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208c1709ee994b97956cc084f8b51cf3 for inclusion in 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:52:59,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-08 22:52:59,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:52:59,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:52:59,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208c1709ee994b97956cc084f8b51cf3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__htm054r5743fuq6tquigblalrkc8heehs4a3o996dhse7gbhrb8k3ros0cb8nikk/family1/208c1709ee994b97956cc084f8b51cf3 2023-11-08 22:52:59,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__htm054r5743fuq6tquigblalrkc8heehs4a3o996dhse7gbhrb8k3ros0cb8nikk/family1/208c1709ee994b97956cc084f8b51cf3 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_ 2023-11-08 22:52:59,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__htm054r5743fuq6tquigblalrkc8heehs4a3o996dhse7gbhrb8k3ros0cb8nikk/family1/208c1709ee994b97956cc084f8b51cf3 into 208b1a13f3708f44bc309e7e19d8ee64/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_ - updating store file list. 2023-11-08 22:52:59,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_ into 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:52:59,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__htm054r5743fuq6tquigblalrkc8heehs4a3o996dhse7gbhrb8k3ros0cb8nikk/family1/208c1709ee994b97956cc084f8b51cf3 into 208b1a13f3708f44bc309e7e19d8ee64/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_) 2023-11-08 22:52:59,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__htm054r5743fuq6tquigblalrkc8heehs4a3o996dhse7gbhrb8k3ros0cb8nikk/family1/208c1709ee994b97956cc084f8b51cf3 2023-11-08 22:52:59,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:52:59,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:52:59,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 208b1a13f3708f44bc309e7e19d8ee64/family1 is initiating minor compaction 2023-11-08 22:52:59,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@19d8eff1; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:52:59,574 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 208b1a13f3708f44bc309e7e19d8ee64/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:52:59,575 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp, totalSize=50.2 K 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting d8e72b1fed1945f19443bcc20f26969a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0cf828cec1fd47a4af6b87298b27efd2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 687cec13a43044eb9b38fa25725166bd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 3c9e5f7c9e7e468b983579eb9eee40b7, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 108a9a96ab2144b19f0680d2629a5eac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting b637035014294678bee40442e8e5079d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 097e08cfaa18451195864fecec6c8f62, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:52:59,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a371fa984c124bf3babdb64c9dad9c00, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:52:59,577 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 14696de964314465a7cbf5047b7690ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:52:59,577 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 89fa8016eeda45349771a49b641ea461_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:52:59,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:52:59,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:52:59,599 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280b3794aa63a24847903c103aa90e8db5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280b3794aa63a24847903c103aa90e8db5 2023-11-08 22:52:59,603 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319348141333bc41578c56325dc48f5d3c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512319348141333bc41578c56325dc48f5d3c 2023-11-08 22:52:59,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed4fd8dd26fe4077b036855c0645bbc3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101ed4fd8dd26fe4077b036855c0645bbc3 2023-11-08 22:52:59,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b21b801ca6f74eaf83f1d643a6e50ffe to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b21b801ca6f74eaf83f1d643a6e50ffe 2023-11-08 22:52:59,608 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-08 22:52:59,608 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:52:59,654 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 208b1a13f3708f44bc309e7e19d8ee64#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:00,489 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/0241883b8c0f4ae397a59461c26c002e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0241883b8c0f4ae397a59461c26c002e 2023-11-08 22:53:00,506 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 208b1a13f3708f44bc309e7e19d8ee64/family1 of 208b1a13f3708f44bc309e7e19d8ee64 into 0241883b8c0f4ae397a59461c26c002e(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:00,506 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:00,507 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1699483979571; duration=0sec 2023-11-08 22:53:00,508 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:00,541 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205fd9775bdf1924dce87dc74faf67de957 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205fd9775bdf1924dce87dc74faf67de957 2023-11-08 22:53:00,543 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:00,575 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/66ce707586ae440c9085e9cc2a35ad65 first=Optional[r00] last=Optional[r2] 2023-11-08 22:53:00,577 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/66ce707586ae440c9085e9cc2a35ad65}] 2023-11-08 22:53:00,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/66ce707586ae440c9085e9cc2a35ad65 for inclusion in 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:00,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-08 22:53:00,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:00,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:00,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/66ce707586ae440c9085e9cc2a35ad65 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e1bh5o53u0e77cci9chocqtt21ahir72baiaem0qot40nteb3jhrh10f515b8gis/family1/66ce707586ae440c9085e9cc2a35ad65 2023-11-08 22:53:00,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e1bh5o53u0e77cci9chocqtt21ahir72baiaem0qot40nteb3jhrh10f515b8gis/family1/66ce707586ae440c9085e9cc2a35ad65 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_ 2023-11-08 22:53:00,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e1bh5o53u0e77cci9chocqtt21ahir72baiaem0qot40nteb3jhrh10f515b8gis/family1/66ce707586ae440c9085e9cc2a35ad65 into 208b1a13f3708f44bc309e7e19d8ee64/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_ - updating store file list. 2023-11-08 22:53:00,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_] to archive 2023-11-08 22:53:00,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:00,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/d8e72b1fed1945f19443bcc20f26969a 2023-11-08 22:53:00,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_ into 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:00,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e1bh5o53u0e77cci9chocqtt21ahir72baiaem0qot40nteb3jhrh10f515b8gis/family1/66ce707586ae440c9085e9cc2a35ad65 into 208b1a13f3708f44bc309e7e19d8ee64/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_) 2023-11-08 22:53:00,616 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0cf828cec1fd47a4af6b87298b27efd2 2023-11-08 22:53:00,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__e1bh5o53u0e77cci9chocqtt21ahir72baiaem0qot40nteb3jhrh10f515b8gis/family1/66ce707586ae440c9085e9cc2a35ad65 2023-11-08 22:53:00,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:53:00,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/687cec13a43044eb9b38fa25725166bd 2023-11-08 22:53:00,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:53:00,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 208b1a13f3708f44bc309e7e19d8ee64/family1 is initiating minor compaction (all files) 2023-11-08 22:53:00,620 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 208b1a13f3708f44bc309e7e19d8ee64/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:00,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3d5328b8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:00,621 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0241883b8c0f4ae397a59461c26c002e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp, totalSize=358.6 K 2023-11-08 22:53:00,622 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting c1b40c6c569145059faca81ef834f786, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850434 2023-11-08 22:53:00,622 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/3c9e5f7c9e7e468b983579eb9eee40b7 2023-11-08 22:53:00,623 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0241883b8c0f4ae397a59461c26c002e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250434 2023-11-08 22:53:00,624 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850434 2023-11-08 22:53:00,624 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/108a9a96ab2144b19f0680d2629a5eac 2023-11-08 22:53:00,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/b637035014294678bee40442e8e5079d 2023-11-08 22:53:00,627 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:00,629 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:00,630 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/097e08cfaa18451195864fecec6c8f62 2023-11-08 22:53:00,633 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130016dd52f6f474f0185b7cab311054648 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130016dd52f6f474f0185b7cab311054648 2023-11-08 22:53:00,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/a371fa984c124bf3babdb64c9dad9c00 2023-11-08 22:53:00,635 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc2fcc2a94584e2581e9340fb5e7bdf5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc2fcc2a94584e2581e9340fb5e7bdf5 2023-11-08 22:53:00,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/14696de964314465a7cbf5047b7690ec 2023-11-08 22:53:00,638 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120593441f90c4c4425a84d8211a90e36d27 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015120593441f90c4c4425a84d8211a90e36d27 2023-11-08 22:53:00,638 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-08 22:53:00,638 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-08 22:53:00,639 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:00,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:00,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:00,640 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:00,642 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/89fa8016eeda45349771a49b641ea461_SeqId_44_ 2023-11-08 22:53:00,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.2920 sec 2023-11-08 22:53:00,684 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 208b1a13f3708f44bc309e7e19d8ee64#family1#compaction#11 average throughput is 4.47 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:00,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-08 22:53:00,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:53:01,293 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-08 22:53:01,295 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:01,295 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-08 22:53:01,300 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-08 22:53:01,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, REOPEN/MOVE}] 2023-11-08 22:53:01,315 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, REOPEN/MOVE 2023-11-08 22:53:01,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:01,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483981316"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483981316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483981316"}]},"ts":"1699483981316"} 2023-11-08 22:53:01,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:01,477 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:01,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 208b1a13f3708f44bc309e7e19d8ee64, disabling compactions & flushes 2023-11-08 22:53:01,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,541 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/.tmp/family1/efd1ec4e3d0945588b70dae5fa8c9b25 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/efd1ec4e3d0945588b70dae5fa8c9b25 2023-11-08 22:53:01,558 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 208b1a13f3708f44bc309e7e19d8ee64/family1 of 208b1a13f3708f44bc309e7e19d8ee64 into efd1ec4e3d0945588b70dae5fa8c9b25(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:01,559 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:01,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. after waiting 0 ms 2023-11-08 22:53:01,559 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,559 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1699483980619; duration=0sec 2023-11-08 22:53:01,559 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:01,565 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0241883b8c0f4ae397a59461c26c002e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_] to archive 2023-11-08 22:53:01,567 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:01,570 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/c1b40c6c569145059faca81ef834f786 2023-11-08 22:53:01,572 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0241883b8c0f4ae397a59461c26c002e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/0241883b8c0f4ae397a59461c26c002e 2023-11-08 22:53:01,575 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/e536c7078e6f47739f1fbf0b983b10f6_SeqId_47_ 2023-11-08 22:53:01,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-08 22:53:01,587 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:01,588 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 208b1a13f3708f44bc309e7e19d8ee64 to self. 2023-11-08 22:53:01,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,592 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=CLOSED 2023-11-08 22:53:01,592 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483981592"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699483981592"}]},"ts":"1699483981592"} 2023-11-08 22:53:01,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-11-08 22:53:01,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133 in 276 msec 2023-11-08 22:53:01,600 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=true 2023-11-08 22:53:01,751 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:01,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483981751"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483981751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483981751"}]},"ts":"1699483981751"} 2023-11-08 22:53:01,754 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:01,909 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:01,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 208b1a13f3708f44bc309e7e19d8ee64, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:01,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,917 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,918 DEBUG [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:01,918 DEBUG [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:01,919 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 208b1a13f3708f44bc309e7e19d8ee64 columnFamilyName family1 2023-11-08 22:53:01,930 DEBUG [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/efd1ec4e3d0945588b70dae5fa8c9b25 2023-11-08 22:53:01,930 INFO [StoreOpener-208b1a13f3708f44bc309e7e19d8ee64-1] regionserver.HStore(310): Store=208b1a13f3708f44bc309e7e19d8ee64/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:01,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:53:01,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 208b1a13f3708f44bc309e7e19d8ee64; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67830213, jitterRate=0.010748937726020813}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:01,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:01,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., pid=17, masterSystemTime=1699483981909 2023-11-08 22:53:01,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:53:01,948 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=208b1a13f3708f44bc309e7e19d8ee64, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:01,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1699483981948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699483981948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699483981948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699483981948"}]},"ts":"1699483981948"} 2023-11-08 22:53:01,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-11-08 22:53:01,953 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 208b1a13f3708f44bc309e7e19d8ee64, server=jenkins-hbase20.apache.org,35543,1699483966133 in 196 msec 2023-11-08 22:53:01,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-11-08 22:53:01,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=208b1a13f3708f44bc309e7e19d8ee64, REOPEN/MOVE in 639 msec 2023-11-08 22:53:01,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-11-08 22:53:01,959 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 658 msec 2023-11-08 22:53:01,962 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0910 sec 2023-11-08 22:53:01,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-08 22:53:01,974 INFO [Listener at localhost/37975] compactions.TestMobCompactor(278): alter status finished 2023-11-08 22:53:01,975 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-08 22:53:01,978 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:01,979 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:01,980 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484581980 2023-11-08 22:53:01,980 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:01,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:01,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-08 22:53:01,982 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:01,984 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x518755d2 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:01,998 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d79b85c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:01,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:01,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:01,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:01,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:01,999 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:02,049 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288739a042f7fa47d2a1612777bfc589e2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511288739a042f7fa47d2a1612777bfc589e2 2023-11-08 22:53:02,051 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:02,067 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:02,068 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:02,083 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:02,087 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:02,117 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/57da2e3363f94bec99ad6b20d0fefccc first=Optional[r05] last=Optional[r8] 2023-11-08 22:53:02,120 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/57da2e3363f94bec99ad6b20d0fefccc}] 2023-11-08 22:53:02,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/57da2e3363f94bec99ad6b20d0fefccc for inclusion in 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:02,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-08 22:53:02,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:02,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:53:02,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/57da2e3363f94bec99ad6b20d0fefccc to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__23bppphc4u6bb9n59c71al304bnoe3c94i1lsn48q0ssmmoogbu4q7eo5a47vh9o/family1/57da2e3363f94bec99ad6b20d0fefccc 2023-11-08 22:53:02,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__23bppphc4u6bb9n59c71al304bnoe3c94i1lsn48q0ssmmoogbu4q7eo5a47vh9o/family1/57da2e3363f94bec99ad6b20d0fefccc as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/93e527e9ba3741168edb9e9e93b79732_SeqId_53_ 2023-11-08 22:53:02,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__23bppphc4u6bb9n59c71al304bnoe3c94i1lsn48q0ssmmoogbu4q7eo5a47vh9o/family1/57da2e3363f94bec99ad6b20d0fefccc into 208b1a13f3708f44bc309e7e19d8ee64/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/93e527e9ba3741168edb9e9e93b79732_SeqId_53_ - updating store file list. 2023-11-08 22:53:02,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/93e527e9ba3741168edb9e9e93b79732_SeqId_53_ into 208b1a13f3708f44bc309e7e19d8ee64/family1 2023-11-08 22:53:02,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__23bppphc4u6bb9n59c71al304bnoe3c94i1lsn48q0ssmmoogbu4q7eo5a47vh9o/family1/57da2e3363f94bec99ad6b20d0fefccc into 208b1a13f3708f44bc309e7e19d8ee64/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/family1/93e527e9ba3741168edb9e9e93b79732_SeqId_53_) 2023-11-08 22:53:02,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__23bppphc4u6bb9n59c71al304bnoe3c94i1lsn48q0ssmmoogbu4q7eo5a47vh9o/family1/57da2e3363f94bec99ad6b20d0fefccc 2023-11-08 22:53:02,153 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:02,154 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:02,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042d5a4249cee4fb59e105ed11e7a9dde to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112042d5a4249cee4fb59e105ed11e7a9dde 2023-11-08 22:53:02,158 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112873d5f22632a741b4ab6ab60c31d155b6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112873d5f22632a741b4ab6ab60c31d155b6 2023-11-08 22:53:02,158 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-08 22:53:02,159 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-08 22:53:02,159 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:02,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:02,160 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-08 22:53:02,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-08 22:53:02,160 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:02,161 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:02,163 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 185 msec 2023-11-08 22:53:02,286 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=252 (was 212) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60642 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1873298475_17 at /127.0.0.1:60796 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60950 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x3d413525 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/920167550.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51f7d398-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x3d413525-SendThread(127.0.0.1:56299) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60742 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51f7d398-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60814 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x3d413525-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: hconnection-0x6d280bc4-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60790 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60786 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d280bc4-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60706 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase20:35543-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60766 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60876 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51f7d398-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51f7d398-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x518755d2-SendThread(127.0.0.1:56299) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60934 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60670 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x51f7d398-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x6d280bc4-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x518755d2-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60828 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x518755d2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/920167550.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:60848 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=622 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 297) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 170) - ProcessCount LEAK? -, AvailableMemoryMB=6865 (was 6885) 2023-11-08 22:53:02,302 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=171, AvailableMemoryMB=6864 2023-11-08 22:53:02,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-08 22:53:02,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:02,308 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:02,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-08 22:53:02,309 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:02,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-08 22:53:02,311 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:02,312 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25 empty. 2023-11-08 22:53:02,313 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:02,313 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-08 22:53:02,334 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:02,335 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7dc65429aff48ca86f09a5f4349ffb25, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:02,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-08 22:53:02,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-08 22:53:02,742 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:02,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 7dc65429aff48ca86f09a5f4349ffb25, disabling compactions & flushes 2023-11-08 22:53:02,743 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:02,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:02,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. after waiting 0 ms 2023-11-08 22:53:02,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:02,743 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:02,743 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:02,746 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:53:02,747 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699483982747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699483982747"}]},"ts":"1699483982747"} 2023-11-08 22:53:02,749 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:53:02,750 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:53:02,750 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483982750"}]},"ts":"1699483982750"} 2023-11-08 22:53:02,752 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-08 22:53:02,755 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7dc65429aff48ca86f09a5f4349ffb25, ASSIGN}] 2023-11-08 22:53:02,756 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7dc65429aff48ca86f09a5f4349ffb25, ASSIGN 2023-11-08 22:53:02,757 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7dc65429aff48ca86f09a5f4349ffb25, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:02,908 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7dc65429aff48ca86f09a5f4349ffb25, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:02,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699483982908"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483982908"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483982908"}]},"ts":"1699483982908"} 2023-11-08 22:53:02,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 7dc65429aff48ca86f09a5f4349ffb25, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:02,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-08 22:53:03,062 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:03,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7dc65429aff48ca86f09a5f4349ffb25, NAME => 'testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,068 INFO [StoreOpener-7dc65429aff48ca86f09a5f4349ffb25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,070 DEBUG [StoreOpener-7dc65429aff48ca86f09a5f4349ffb25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:03,070 DEBUG [StoreOpener-7dc65429aff48ca86f09a5f4349ffb25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:03,071 INFO [StoreOpener-7dc65429aff48ca86f09a5f4349ffb25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7dc65429aff48ca86f09a5f4349ffb25 columnFamilyName family1 2023-11-08 22:53:03,072 INFO [StoreOpener-7dc65429aff48ca86f09a5f4349ffb25-1] regionserver.HStore(310): Store=7dc65429aff48ca86f09a5f4349ffb25/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:03,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,077 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:53:03,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:03,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7dc65429aff48ca86f09a5f4349ffb25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64903296, jitterRate=-0.03286552429199219}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:03,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:03,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., pid=21, masterSystemTime=1699483983062 2023-11-08 22:53:03,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:03,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:03,083 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=7dc65429aff48ca86f09a5f4349ffb25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,083 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699483983083"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699483983083"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699483983083"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699483983083"}]},"ts":"1699483983083"} 2023-11-08 22:53:03,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-11-08 22:53:03,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 7dc65429aff48ca86f09a5f4349ffb25, server=jenkins-hbase20.apache.org,35543,1699483966133 in 175 msec 2023-11-08 22:53:03,089 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-11-08 22:53:03,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=7dc65429aff48ca86f09a5f4349ffb25, ASSIGN in 332 msec 2023-11-08 22:53:03,090 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:53:03,091 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483983090"}]},"ts":"1699483983090"} 2023-11-08 22:53:03,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-08 22:53:03,094 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:53:03,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 789 msec 2023-11-08 22:53:03,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-08 22:53:03,416 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-08 22:53:03,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:03,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,463 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:03,463 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:03,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:03,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:03,465 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,465 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,466 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:03,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:03,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:03,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:03,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,467 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,468 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:03,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:03,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:03,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:03,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:03,471 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:03,471 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:03,472 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:53:03,502 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304d7fed26f921498a994072a2273a8369 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304d7fed26f921498a994072a2273a8369 2023-11-08 22:53:03,907 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/f3c6815c866442a38de3ffee713378a2 2023-11-08 22:53:03,916 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/f3c6815c866442a38de3ffee713378a2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2 2023-11-08 22:53:03,923 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-08 22:53:03,924 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 452ms, sequenceid=5, compaction requested=false 2023-11-08 22:53:03,924 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:03,925 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:03,925 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:03,925 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:03,925 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:03,925 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,925 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:03,925 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:03,927 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,927 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:03,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:03,928 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,928 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:03,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:03,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:03,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:03,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1be6842f[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:03,930 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:03,931 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,932 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,932 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:03,932 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:03,932 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:03,933 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,933 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:03,934 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:03,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,934 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:03,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:03,934 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:03,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:03,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:03,938 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:03,938 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:03,938 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:03,938 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,938 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:03,940 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,940 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:03,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,941 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:03,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:03,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:03,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,944 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:03,949 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:03,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:03,950 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:03,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:03,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:03,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:03,950 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:03,951 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:03,951 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:03,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:03,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:03,952 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:04,051 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:04,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:04,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,065 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:04,065 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:04,066 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:04,066 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:04,066 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,066 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,067 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:04,067 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:04,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:04,068 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,068 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,068 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:04,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,069 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,069 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:04,069 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,069 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:04,069 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:04,070 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:04,070 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:04,070 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:04,070 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:04,070 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:04,070 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:53:04,096 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112853eb302f37394194bad7fb0a0f0e39f5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853eb302f37394194bad7fb0a0f0e39f5 2023-11-08 22:53:04,110 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/bf99ff4ac2bf45aa9a569bdac429eb12 2023-11-08 22:53:04,119 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/bf99ff4ac2bf45aa9a569bdac429eb12 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12 2023-11-08 22:53:04,134 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:53:04,136 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 66ms, sequenceid=9, compaction requested=false 2023-11-08 22:53:04,136 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:04,136 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:04,136 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:04,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:04,139 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,139 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:04,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:04,139 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,139 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:04,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:04,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@55ed2690[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:04,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:04,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,142 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:04,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:04,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:04,143 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,143 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:04,144 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:04,144 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:04,144 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:04,145 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:04,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:04,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:04,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:04,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:04,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:04,152 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:04,153 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:04,153 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:04,153 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,153 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:04,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:04,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:04,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,158 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:04,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:04,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:04,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,160 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,165 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:04,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:04,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,166 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:04,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:04,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:04,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:04,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:04,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:04,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,167 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:04,168 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:04,268 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:04,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:04,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:04,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:04,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,278 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:04,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:04,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:04,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:04,280 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,280 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,280 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:04,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:04,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:04,281 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:04,281 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:04,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:04,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,282 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,282 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:04,282 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:04,282 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:04,282 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:04,282 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:04,283 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:04,283 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:04,283 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:04,283 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:04,283 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:04,702 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018cce9e09c7a846cbb14edfb8941d757b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018cce9e09c7a846cbb14edfb8941d757b 2023-11-08 22:53:05,110 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/9ca847fbbb4141cf990cc02450373039 2023-11-08 22:53:05,123 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/9ca847fbbb4141cf990cc02450373039 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039 2023-11-08 22:53:05,130 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039, entries=1, sequenceid=13, filesize=4.9 K 2023-11-08 22:53:05,131 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 848ms, sequenceid=13, compaction requested=true 2023-11-08 22:53:05,131 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:05,131 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:05,131 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:05,131 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:05,131 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,131 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:05,131 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:05,132 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,132 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,133 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,133 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:05,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c19a1a2[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:05,134 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:05,135 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,135 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,135 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:05,135 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,136 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:05,135 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:05,136 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:05,137 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:05,137 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:05,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:05,141 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:05,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:05,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:05,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,141 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:05,142 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,142 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,142 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,143 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,144 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:05,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:05,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:05,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:05,147 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:05,148 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:05,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:05,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:05,148 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:05,248 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:05,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:05,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:05,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:05,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,261 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:05,261 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:05,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:05,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:05,263 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,263 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,264 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:05,264 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:05,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:05,266 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:05,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,267 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:05,267 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:05,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:05,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:05,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:05,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:05,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:05,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:05,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:05,690 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205be282f14d0364da7836355f4decec31a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205be282f14d0364da7836355f4decec31a 2023-11-08 22:53:05,698 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/32e5304e630e4d8fa13d4a7b29688a07 2023-11-08 22:53:05,704 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/32e5304e630e4d8fa13d4a7b29688a07 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07 2023-11-08 22:53:05,709 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07, entries=1, sequenceid=17, filesize=4.9 K 2023-11-08 22:53:05,710 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 442ms, sequenceid=17, compaction requested=true 2023-11-08 22:53:05,711 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:05,711 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:05,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:05,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:05,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:05,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:05,713 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:05,714 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bf530eb[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:05,714 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:05,714 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,715 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,715 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:05,715 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:05,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:05,715 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:05,717 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:05,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:05,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:05,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:05,729 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:05,729 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:05,729 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:05,729 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,729 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:05,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:05,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,732 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:05,733 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,734 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:05,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:05,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:05,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:05,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:05,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:05,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:05,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:05,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,737 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:05,737 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:05,837 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:05,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:05,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:05,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:05,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,845 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:05,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:05,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:05,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:05,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,848 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:05,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:05,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:05,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:05,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:05,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,849 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:05,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:05,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:05,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:05,851 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:05,851 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:05,851 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:05,851 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:05,851 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:05,851 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:06,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228407a79bc007f499288cdfcca002c3f91 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228407a79bc007f499288cdfcca002c3f91 2023-11-08 22:53:06,279 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/8cb58cf9333143569413b7a647f950f6 2023-11-08 22:53:06,289 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/8cb58cf9333143569413b7a647f950f6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6 2023-11-08 22:53:06,298 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6, entries=1, sequenceid=21, filesize=4.9 K 2023-11-08 22:53:06,299 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 448ms, sequenceid=21, compaction requested=true 2023-11-08 22:53:06,299 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:06,299 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:06,299 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:06,299 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:06,299 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,300 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:06,300 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:06,302 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,302 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:06,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:06,303 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,303 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:06,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:06,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:06,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@549d0446[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:06,307 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:06,308 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,308 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:06,309 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:06,315 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,315 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:06,324 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:06,324 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,324 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:06,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:06,324 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:06,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:06,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:06,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:06,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:06,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:06,328 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:06,328 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:06,328 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:06,328 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:06,328 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,328 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:06,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:06,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:06,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:06,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:06,333 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,337 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,345 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:06,346 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:06,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:06,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:06,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:06,346 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,346 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,346 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:06,346 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:06,347 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:06,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:06,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:06,447 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:06,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:06,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:06,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:06,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,456 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:06,456 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:06,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:06,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:06,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,459 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,459 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:06,459 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:06,459 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:06,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:06,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:06,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:06,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,463 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,463 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:06,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:06,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:06,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:06,465 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:06,465 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:06,465 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:06,465 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:06,465 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:06,893 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231892359e16f9f49889e60ff44be10cd50 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231892359e16f9f49889e60ff44be10cd50 2023-11-08 22:53:07,122 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:53:07,302 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/570aa692de1741f4b711bbd2ad8a2e9a 2023-11-08 22:53:07,312 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/570aa692de1741f4b711bbd2ad8a2e9a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a 2023-11-08 22:53:07,324 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-08 22:53:07,326 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 861ms, sequenceid=25, compaction requested=true 2023-11-08 22:53:07,326 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:07,326 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:07,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:07,515 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:07,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:07,516 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,516 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:07,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:07,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:07,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:07,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@68f861e3[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:07,522 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:07,522 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,758 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:07,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:07,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:07,759 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,759 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:07,859 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:07,859 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,860 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:07,860 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:07,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:07,863 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:07,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:07,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:07,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,864 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:07,925 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,925 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,925 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:07,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:07,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:07,925 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:07,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,931 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,933 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,933 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,934 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:07,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:07,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:07,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:07,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:07,934 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:07,935 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:07,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:07,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:07,935 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:08,035 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:08,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:08,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:08,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:08,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,045 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:08,045 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:08,046 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:08,046 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:08,046 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,046 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,047 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,047 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:08,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:08,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:08,048 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,048 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:08,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,049 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,049 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:08,049 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,049 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:08,049 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:08,049 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:08,050 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:08,050 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:08,050 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:08,050 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:08,050 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:08,469 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e65423eaad3c4460bf9fcfd6b4425721 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e65423eaad3c4460bf9fcfd6b4425721 2023-11-08 22:53:08,475 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/5d48678646514955908dfef07ccc0ae0 2023-11-08 22:53:08,481 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/5d48678646514955908dfef07ccc0ae0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0 2023-11-08 22:53:08,487 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0, entries=1, sequenceid=29, filesize=4.9 K 2023-11-08 22:53:08,488 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 438ms, sequenceid=29, compaction requested=true 2023-11-08 22:53:08,488 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:08,488 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:08,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:08,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:08,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:08,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:08,495 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:08,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:08,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:08,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:08,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@98dc9ef[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:08,497 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:08,497 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,515 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:08,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:08,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:08,515 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,516 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:08,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:08,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:08,517 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:08,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:08,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:08,520 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:08,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:08,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:08,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,520 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:08,521 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,521 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:08,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,522 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:08,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:08,522 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,523 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:08,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:08,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:08,526 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:08,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:08,525 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,526 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,526 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,526 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,527 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:08,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:08,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:08,527 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:08,627 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:08,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:08,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:08,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:08,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,638 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:08,638 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:08,639 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:08,639 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:08,639 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,639 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,640 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:08,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:08,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:08,641 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:08,641 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:08,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:08,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,642 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,642 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:08,642 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:08,643 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:08,643 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:08,644 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:08,644 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:08,644 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:08,644 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:08,644 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:08,644 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:09,065 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010329ee47006baa4ff3a170ef18a965c7aa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010329ee47006baa4ff3a170ef18a965c7aa 2023-11-08 22:53:09,473 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/bbb24c6e259b4fb0b6c70d0837d6719c 2023-11-08 22:53:09,480 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/bbb24c6e259b4fb0b6c70d0837d6719c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c 2023-11-08 22:53:09,486 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c, entries=1, sequenceid=33, filesize=4.9 K 2023-11-08 22:53:09,487 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 843ms, sequenceid=33, compaction requested=true 2023-11-08 22:53:09,487 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:09,487 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:09,487 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:09,487 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:09,487 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,487 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:09,487 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:09,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,488 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:09,489 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,489 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:09,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:09,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:09,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b2dd25d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:09,490 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:09,490 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,492 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,492 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:09,492 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:09,492 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,492 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:09,492 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:09,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:09,493 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:09,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:09,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:09,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:09,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:09,500 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:09,500 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:09,500 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:09,500 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:09,500 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,500 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:09,507 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,507 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:09,507 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:09,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,507 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,508 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,511 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,511 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:09,511 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:09,511 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,511 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:09,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:09,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:09,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:09,511 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:09,512 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:09,612 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:09,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:09,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:09,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:09,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,623 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:09,623 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:09,623 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:09,623 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:09,624 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,624 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:09,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:09,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:09,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:09,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:09,625 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:09,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,626 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,626 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:09,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:09,626 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:09,626 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:09,627 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:09,627 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:09,627 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:09,627 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:09,627 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:09,627 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:10,043 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907cf726182913d4f61b6cfd9034a02f717 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907cf726182913d4f61b6cfd9034a02f717 2023-11-08 22:53:10,450 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/70f6c5ab0fa84951bea1b1acc38b4d88 2023-11-08 22:53:10,462 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/70f6c5ab0fa84951bea1b1acc38b4d88 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88 2023-11-08 22:53:10,470 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88, entries=1, sequenceid=37, filesize=4.9 K 2023-11-08 22:53:10,471 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 844ms, sequenceid=37, compaction requested=true 2023-11-08 22:53:10,471 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:10,471 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:10,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:10,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:10,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,472 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:10,472 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:10,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,473 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:10,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:10,474 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,474 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:10,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:10,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:10,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67ae424a[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:10,476 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:10,476 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,477 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,477 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:10,477 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:10,477 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:10,477 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,477 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:10,478 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,478 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:10,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:10,478 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:10,478 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:10,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:10,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:10,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:10,481 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:10,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:10,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:10,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,481 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:10,483 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,483 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,483 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:10,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:10,483 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:10,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,484 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,488 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:10,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:10,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:10,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:10,488 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:10,489 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:10,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:10,490 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:10,490 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:10,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:10,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:10,590 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:10,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:10,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:10,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:10,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,606 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:10,606 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:10,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:53:10,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:10,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,608 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,609 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:10,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:10,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:10,610 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:10,610 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:10,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,611 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,611 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:53:10,611 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:10,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:53:10,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:10,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:53:10,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:10,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:10,614 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:10,614 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. started... 2023-11-08 22:53:10,614 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 7dc65429aff48ca86f09a5f4349ffb25 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:11,040 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206ca9597241884b16b01484b2419ad944 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511206ca9597241884b16b01484b2419ad944 2023-11-08 22:53:11,447 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2 2023-11-08 22:53:11,459 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2 2023-11-08 22:53:11,467 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2, entries=1, sequenceid=41, filesize=4.9 K 2023-11-08 22:53:11,468 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7dc65429aff48ca86f09a5f4349ffb25 in 854ms, sequenceid=41, compaction requested=true 2023-11-08 22:53:11,468 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:11,468 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:11,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:11,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:11,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:53:11,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:53:11,470 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,470 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:11,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:11,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,471 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:11,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:11,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:11,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:53:11,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4cf2d025[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:11,472 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:11,472 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,473 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:11,473 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:53:11,473 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:11,473 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,473 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:11,474 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,474 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:53:11,474 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:11,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:11,474 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:53:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:11,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:11,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:11,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:11,477 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:53:11,477 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:11,477 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:11,477 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,477 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:11,478 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,478 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,478 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:11,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:11,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:11,479 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,480 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:11,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,481 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,481 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:11,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:11,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:11,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-08 22:53:11,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:11,482 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:53:11,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:11,482 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:11,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:11,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,483 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:11,484 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:11,483 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:11,484 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:11,584 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:11,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:11,587 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-08 22:53:11,588 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:11,589 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:11,591 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:11,591 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484591591 2023-11-08 22:53:11,592 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:11,594 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-08 22:53:11,594 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:11,596 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x21f53dbd to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:11,601 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@513eca87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:11,601 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:12,039 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103e45ec3e12b674fefa7cc9c61965fd6ac to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103e45ec3e12b674fefa7cc9c61965fd6ac 2023-11-08 22:53:12,041 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:12,056 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:12,057 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37046, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:12,064 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:12,065 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:12,077 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f6dc0df9cca94f55a0946594f791436d first=Optional[r5] last=Optional[r6] 2023-11-08 22:53:12,078 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f6dc0df9cca94f55a0946594f791436d}] 2023-11-08 22:53:12,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f6dc0df9cca94f55a0946594f791436d for inclusion in 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-08 22:53:12,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:12,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:12,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/f6dc0df9cca94f55a0946594f791436d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3ahv4krummodtiho1pi28unnqvcsh6blr0fsiv5dtpd4la5rlvvp9uv89st09k8m/family1/f6dc0df9cca94f55a0946594f791436d 2023-11-08 22:53:12,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3ahv4krummodtiho1pi28unnqvcsh6blr0fsiv5dtpd4la5rlvvp9uv89st09k8m/family1/f6dc0df9cca94f55a0946594f791436d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_ 2023-11-08 22:53:12,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3ahv4krummodtiho1pi28unnqvcsh6blr0fsiv5dtpd4la5rlvvp9uv89st09k8m/family1/f6dc0df9cca94f55a0946594f791436d into 7dc65429aff48ca86f09a5f4349ffb25/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_ - updating store file list. 2023-11-08 22:53:12,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_ into 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:12,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3ahv4krummodtiho1pi28unnqvcsh6blr0fsiv5dtpd4la5rlvvp9uv89st09k8m/family1/f6dc0df9cca94f55a0946594f791436d into 7dc65429aff48ca86f09a5f4349ffb25/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_) 2023-11-08 22:53:12,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3ahv4krummodtiho1pi28unnqvcsh6blr0fsiv5dtpd4la5rlvvp9uv89st09k8m/family1/f6dc0df9cca94f55a0946594f791436d 2023-11-08 22:53:12,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:53:12,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:53:12,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 7dc65429aff48ca86f09a5f4349ffb25/family1 is initiating minor compaction 2023-11-08 22:53:12,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4a3b3987; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:12,107 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7dc65429aff48ca86f09a5f4349ffb25/family1 in testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:12,107 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp, totalSize=49.7 K 2023-11-08 22:53:12,107 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting bf99ff4ac2bf45aa9a569bdac429eb12, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:53:12,107 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 9ca847fbbb4141cf990cc02450373039, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:53:12,107 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 32e5304e630e4d8fa13d4a7b29688a07, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:53:12,107 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 8cb58cf9333143569413b7a647f950f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:53:12,107 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 570aa692de1741f4b711bbd2ad8a2e9a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:53:12,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 5d48678646514955908dfef07ccc0ae0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:53:12,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting bbb24c6e259b4fb0b6c70d0837d6719c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:53:12,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 70f6c5ab0fa84951bea1b1acc38b4d88, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:53:12,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting dca8bc2ff08a4ce7a5f0bf1635c914b2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:53:12,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting d8396c0d455e4584b564412eacdb09c9_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:53:12,109 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:12,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:12,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e65423eaad3c4460bf9fcfd6b4425721 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160101e65423eaad3c4460bf9fcfd6b4425721 2023-11-08 22:53:12,113 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010329ee47006baa4ff3a170ef18a965c7aa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010329ee47006baa4ff3a170ef18a965c7aa 2023-11-08 22:53:12,113 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-08 22:53:12,113 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-08 22:53:12,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:12,113 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:12,145 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7dc65429aff48ca86f09a5f4349ffb25#family1#compaction#22 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:12,568 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/d887908098cb458d9bea4dbf0f4371a8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d887908098cb458d9bea4dbf0f4371a8 2023-11-08 22:53:12,575 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7dc65429aff48ca86f09a5f4349ffb25/family1 of 7dc65429aff48ca86f09a5f4349ffb25 into d887908098cb458d9bea4dbf0f4371a8(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:12,575 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:12,576 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699483992106; duration=0sec 2023-11-08 22:53:12,576 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:12,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_] to archive 2023-11-08 22:53:12,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:12,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bf99ff4ac2bf45aa9a569bdac429eb12 2023-11-08 22:53:12,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/9ca847fbbb4141cf990cc02450373039 2023-11-08 22:53:12,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/32e5304e630e4d8fa13d4a7b29688a07 2023-11-08 22:53:12,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/8cb58cf9333143569413b7a647f950f6 2023-11-08 22:53:12,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/570aa692de1741f4b711bbd2ad8a2e9a 2023-11-08 22:53:12,615 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/5d48678646514955908dfef07ccc0ae0 2023-11-08 22:53:12,617 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/bbb24c6e259b4fb0b6c70d0837d6719c 2023-11-08 22:53:12,618 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/70f6c5ab0fa84951bea1b1acc38b4d88 2023-11-08 22:53:12,628 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/dca8bc2ff08a4ce7a5f0bf1635c914b2 2023-11-08 22:53:12,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d8396c0d455e4584b564412eacdb09c9_SeqId_44_ 2023-11-08 22:53:12,975 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123149adac80730d4fe7aaf15be4449041d8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123149adac80730d4fe7aaf15be4449041d8 2023-11-08 22:53:12,976 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:13,012 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d96965b07c3d4fa081e8c4d332e9a1c9 first=Optional[r1] last=Optional[r4] 2023-11-08 22:53:13,013 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d96965b07c3d4fa081e8c4d332e9a1c9}] 2023-11-08 22:53:13,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d96965b07c3d4fa081e8c4d332e9a1c9 for inclusion in 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-08 22:53:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:13,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:13,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/d96965b07c3d4fa081e8c4d332e9a1c9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nqpug0ivesjtur443g9b3sj1cphgat5hsbh7lviclij5bj3tob8m8dfjk8din3do/family1/d96965b07c3d4fa081e8c4d332e9a1c9 2023-11-08 22:53:13,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nqpug0ivesjtur443g9b3sj1cphgat5hsbh7lviclij5bj3tob8m8dfjk8din3do/family1/d96965b07c3d4fa081e8c4d332e9a1c9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_ 2023-11-08 22:53:13,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nqpug0ivesjtur443g9b3sj1cphgat5hsbh7lviclij5bj3tob8m8dfjk8din3do/family1/d96965b07c3d4fa081e8c4d332e9a1c9 into 7dc65429aff48ca86f09a5f4349ffb25/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_ - updating store file list. 2023-11-08 22:53:13,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_ into 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:13,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nqpug0ivesjtur443g9b3sj1cphgat5hsbh7lviclij5bj3tob8m8dfjk8din3do/family1/d96965b07c3d4fa081e8c4d332e9a1c9 into 7dc65429aff48ca86f09a5f4349ffb25/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_) 2023-11-08 22:53:13,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__nqpug0ivesjtur443g9b3sj1cphgat5hsbh7lviclij5bj3tob8m8dfjk8din3do/family1/d96965b07c3d4fa081e8c4d332e9a1c9 2023-11-08 22:53:13,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:53:13,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:53:13,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 7dc65429aff48ca86f09a5f4349ffb25/family1 is initiating minor compaction (all files) 2023-11-08 22:53:13,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@63be5f15; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:13,034 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 7dc65429aff48ca86f09a5f4349ffb25/family1 in testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:53:13,035 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d887908098cb458d9bea4dbf0f4371a8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp, totalSize=178.1 K 2023-11-08 22:53:13,035 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting f3c6815c866442a38de3ffee713378a2, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850434 2023-11-08 22:53:13,036 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting d887908098cb458d9bea4dbf0f4371a8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250434 2023-11-08 22:53:13,036 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 4659a99a580048a4a3a6271afd46322c_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965250434 2023-11-08 22:53:13,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:13,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:13,039 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018cce9e09c7a846cbb14edfb8941d757b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512018cce9e09c7a846cbb14edfb8941d757b 2023-11-08 22:53:13,040 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205be282f14d0364da7836355f4decec31a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205be282f14d0364da7836355f4decec31a 2023-11-08 22:53:13,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228407a79bc007f499288cdfcca002c3f91 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228407a79bc007f499288cdfcca002c3f91 2023-11-08 22:53:13,043 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231892359e16f9f49889e60ff44be10cd50 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231892359e16f9f49889e60ff44be10cd50 2023-11-08 22:53:13,043 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-08 22:53:13,043 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-08 22:53:13,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:13,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:13,058 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7dc65429aff48ca86f09a5f4349ffb25#family1#compaction#23 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:13,098 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ee258bc29b474c00883a8a675c964115 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ee258bc29b474c00883a8a675c964115 2023-11-08 22:53:13,099 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:13,127 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cca0aa29e2e8435c838fd04abdb19b88 first=Optional[r00] last=Optional[r8] 2023-11-08 22:53:13,127 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cca0aa29e2e8435c838fd04abdb19b88}] 2023-11-08 22:53:13,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cca0aa29e2e8435c838fd04abdb19b88 for inclusion in 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:13,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-08 22:53:13,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:13,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:13,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/cca0aa29e2e8435c838fd04abdb19b88 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ojplcbmr7rbjf38n1t2q47q7i8kkja760avd9nurqsn23nkgq3msts576lojgbpv/family1/cca0aa29e2e8435c838fd04abdb19b88 2023-11-08 22:53:13,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ojplcbmr7rbjf38n1t2q47q7i8kkja760avd9nurqsn23nkgq3msts576lojgbpv/family1/cca0aa29e2e8435c838fd04abdb19b88 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/17579471daf9418dabba533c27922b69_SeqId_49_ 2023-11-08 22:53:13,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ojplcbmr7rbjf38n1t2q47q7i8kkja760avd9nurqsn23nkgq3msts576lojgbpv/family1/cca0aa29e2e8435c838fd04abdb19b88 into 7dc65429aff48ca86f09a5f4349ffb25/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/17579471daf9418dabba533c27922b69_SeqId_49_ - updating store file list. 2023-11-08 22:53:13,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/17579471daf9418dabba533c27922b69_SeqId_49_ into 7dc65429aff48ca86f09a5f4349ffb25/family1 2023-11-08 22:53:13,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ojplcbmr7rbjf38n1t2q47q7i8kkja760avd9nurqsn23nkgq3msts576lojgbpv/family1/cca0aa29e2e8435c838fd04abdb19b88 into 7dc65429aff48ca86f09a5f4349ffb25/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/17579471daf9418dabba533c27922b69_SeqId_49_) 2023-11-08 22:53:13,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithMonthlyPolicy__ojplcbmr7rbjf38n1t2q47q7i8kkja760avd9nurqsn23nkgq3msts576lojgbpv/family1/cca0aa29e2e8435c838fd04abdb19b88 2023-11-08 22:53:13,146 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:13,146 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:13,148 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511206ca9597241884b16b01484b2419ad944 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511206ca9597241884b16b01484b2419ad944 2023-11-08 22:53:13,149 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853eb302f37394194bad7fb0a0f0e39f5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112853eb302f37394194bad7fb0a0f0e39f5 2023-11-08 22:53:13,150 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304d7fed26f921498a994072a2273a8369 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304d7fed26f921498a994072a2273a8369 2023-11-08 22:53:13,150 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-08 22:53:13,150 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-08 22:53:13,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:13,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:13,150 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:53:13,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:53:13,150 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:13,151 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:13,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5640 sec 2023-11-08 22:53:13,248 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=264 (was 252) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48404 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-314655194-148.251.75.209-1699483961994:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48382 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48522 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48524 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/4e7e75065a5c4632b34d46f6d45a81e9 block BP-314655194-148.251.75.209-1699483961994:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48346 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48482 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x21f53dbd-SendThread(127.0.0.1:56299) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48414 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48512 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ebb19056830c489fbb627965a70f9e71_del java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48330 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x21f53dbd-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48370 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56299@0x21f53dbd sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/920167550.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48446 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48294 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48484 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-481 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1873298475_17 at /127.0.0.1:48436 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48358 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ResponseProcessor for block BP-314655194-148.251.75.209-1699483961994:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48442 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7ce58d4f-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5a7a86df-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1873298475_17 at /127.0.0.1:48448 [Receiving block BP-314655194-148.251.75.209-1699483961994:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-484667995_17 at /127.0.0.1:48438 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=644 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=268 (was 317), ProcessCount=169 (was 171), AvailableMemoryMB=6516 (was 6864) 2023-11-08 22:53:13,257 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=264, OpenFileDescriptor=644, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=169, AvailableMemoryMB=6516 2023-11-08 22:53:13,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:53:13,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:13,263 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:13,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-08 22:53:13,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:13,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:13,265 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:13,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544 empty. 2023-11-08 22:53:13,266 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:13,266 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-08 22:53:13,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:13,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:13,676 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:13,679 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 347fa17718a32e5504a20f4e076a1544, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:13,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:13,888 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/.tmp/family1/4e7e75065a5c4632b34d46f6d45a81e9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4e7e75065a5c4632b34d46f6d45a81e9 2023-11-08 22:53:13,897 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7dc65429aff48ca86f09a5f4349ffb25/family1 of 7dc65429aff48ca86f09a5f4349ffb25 into 4e7e75065a5c4632b34d46f6d45a81e9(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:13,898 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:53:13,898 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699483993034; duration=0sec 2023-11-08 22:53:13,898 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:13,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d887908098cb458d9bea4dbf0f4371a8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_] to archive 2023-11-08 22:53:13,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:13,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/f3c6815c866442a38de3ffee713378a2 2023-11-08 22:53:14,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d887908098cb458d9bea4dbf0f4371a8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/d887908098cb458d9bea4dbf0f4371a8 2023-11-08 22:53:14,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/family1/4659a99a580048a4a3a6271afd46322c_SeqId_47_ 2023-11-08 22:53:14,090 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:14,090 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 347fa17718a32e5504a20f4e076a1544, disabling compactions & flushes 2023-11-08 22:53:14,091 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. after waiting 0 ms 2023-11-08 22:53:14,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,091 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,091 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:14,094 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:53:14,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699483994096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699483994096"}]},"ts":"1699483994096"} 2023-11-08 22:53:14,098 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:53:14,099 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:53:14,099 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483994099"}]},"ts":"1699483994099"} 2023-11-08 22:53:14,101 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-08 22:53:14,105 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=347fa17718a32e5504a20f4e076a1544, ASSIGN}] 2023-11-08 22:53:14,107 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=347fa17718a32e5504a20f4e076a1544, ASSIGN 2023-11-08 22:53:14,109 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=347fa17718a32e5504a20f4e076a1544, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:14,261 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=347fa17718a32e5504a20f4e076a1544, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:14,261 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699483994261"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699483994261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699483994261"}]},"ts":"1699483994261"} 2023-11-08 22:53:14,266 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 347fa17718a32e5504a20f4e076a1544, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:14,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:14,420 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:14,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 347fa17718a32e5504a20f4e076a1544, NAME => 'testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:14,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:14,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,430 INFO [StoreOpener-347fa17718a32e5504a20f4e076a1544-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,433 DEBUG [StoreOpener-347fa17718a32e5504a20f4e076a1544-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:14,433 DEBUG [StoreOpener-347fa17718a32e5504a20f4e076a1544-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:14,434 INFO [StoreOpener-347fa17718a32e5504a20f4e076a1544-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 347fa17718a32e5504a20f4e076a1544 columnFamilyName family1 2023-11-08 22:53:14,438 INFO [StoreOpener-347fa17718a32e5504a20f4e076a1544-1] regionserver.HStore(310): Store=347fa17718a32e5504a20f4e076a1544/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:14,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:53:14,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:14,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 347fa17718a32e5504a20f4e076a1544; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66861774, jitterRate=-0.0036819279193878174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:14,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:14,451 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544., pid=25, masterSystemTime=1699483994420 2023-11-08 22:53:14,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:14,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=347fa17718a32e5504a20f4e076a1544, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:14,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699483994454"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699483994454"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699483994454"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699483994454"}]},"ts":"1699483994454"} 2023-11-08 22:53:14,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-11-08 22:53:14,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 347fa17718a32e5504a20f4e076a1544, server=jenkins-hbase20.apache.org,35543,1699483966133 in 191 msec 2023-11-08 22:53:14,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-11-08 22:53:14,462 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=347fa17718a32e5504a20f4e076a1544, ASSIGN in 354 msec 2023-11-08 22:53:14,463 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:53:14,464 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699483994463"}]},"ts":"1699483994463"} 2023-11-08 22:53:14,465 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-08 22:53:14,468 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:53:14,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2080 sec 2023-11-08 22:53:15,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-08 22:53:15,375 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-08 22:53:15,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:15,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,410 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:15,410 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:15,410 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:15,410 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:15,411 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,411 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,412 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:15,412 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:15,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:15,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:15,413 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:15,413 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:15,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,413 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,414 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:15,414 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:15,414 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:15,414 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:15,414 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:15,414 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:15,414 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:15,414 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:15,415 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:53:15,842 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130862dd0154f704c7caac9d2b5ddbbee55 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130862dd0154f704c7caac9d2b5ddbbee55 2023-11-08 22:53:16,249 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/0b47ebe50d704a2bb91432af8d2544d9 2023-11-08 22:53:16,262 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/0b47ebe50d704a2bb91432af8d2544d9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/0b47ebe50d704a2bb91432af8d2544d9 2023-11-08 22:53:16,267 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/0b47ebe50d704a2bb91432af8d2544d9, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-08 22:53:16,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 854ms, sequenceid=5, compaction requested=false 2023-11-08 22:53:16,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:16,269 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:16,269 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:16,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:16,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:16,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:16,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:16,271 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:16,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:16,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:16,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:16,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:16,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:16,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b57aae5[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:16,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:16,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:16,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:16,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:16,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:16,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:16,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:16,275 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:16,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:16,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:16,278 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:16,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:16,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:16,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,278 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:16,279 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,279 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:16,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,279 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:16,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:16,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:16,280 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,281 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:16,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:16,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:16,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:16,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:16,283 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:16,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:16,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:16,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,284 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:16,384 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:16,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:16,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:16,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:16,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,399 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:16,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:16,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:16,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:16,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,402 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:16,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:16,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:16,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:16,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:16,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:16,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:16,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:16,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:16,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:16,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:16,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:16,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:16,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:16,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:53:16,820 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284380005ee85b4f63abdc14d0a5a839e1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511284380005ee85b4f63abdc14d0a5a839e1 2023-11-08 22:53:17,230 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/e2aedb678dbf41809142d7518d89ac0c 2023-11-08 22:53:17,243 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/e2aedb678dbf41809142d7518d89ac0c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c 2023-11-08 22:53:17,248 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:53:17,249 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 845ms, sequenceid=9, compaction requested=false 2023-11-08 22:53:17,249 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:17,249 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:17,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:17,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:17,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:17,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:17,252 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:17,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:17,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:17,254 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e5d2ae8[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:17,254 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:17,254 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,254 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,255 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,255 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:17,255 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:17,255 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:17,255 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,255 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:17,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:17,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:17,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:17,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:17,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:17,259 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:17,259 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:17,259 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:17,259 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,259 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:17,265 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,265 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:17,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,265 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:17,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:17,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:17,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,267 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:17,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:17,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:17,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:17,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:17,275 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:17,275 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:17,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:17,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:17,375 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:17,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:17,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:17,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:17,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,391 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:17,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:17,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:17,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:17,393 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,393 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,395 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:17,395 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:17,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:17,396 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:17,396 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:17,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,397 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:17,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,398 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,399 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:17,399 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:17,399 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:17,399 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:17,399 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:17,400 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:17,400 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:17,400 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:17,400 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:17,400 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:17,832 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201f3f18bccc2df4aad8347e4dde46942ac to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3f18bccc2df4aad8347e4dde46942ac 2023-11-08 22:53:18,240 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/d3636e4a9a5b44c79efa6216f30af844 2023-11-08 22:53:18,248 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/d3636e4a9a5b44c79efa6216f30af844 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844 2023-11-08 22:53:18,256 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844, entries=1, sequenceid=13, filesize=4.9 K 2023-11-08 22:53:18,257 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 857ms, sequenceid=13, compaction requested=true 2023-11-08 22:53:18,257 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:18,257 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:18,257 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:18,257 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:18,257 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,257 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:18,257 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:18,259 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:18,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:18,260 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,260 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:18,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:18,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:18,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:18,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b74977b[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:18,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:18,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,263 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:18,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:18,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:18,264 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,264 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:18,265 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:18,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:18,266 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:18,266 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:18,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:18,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:18,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:18,270 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:18,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:18,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:18,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,270 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:18,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:18,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:18,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:18,282 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:18,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,284 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,290 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:18,290 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:18,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:18,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:18,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,291 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:18,291 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:18,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:18,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:18,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,391 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:18,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:18,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:18,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:18,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,399 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:18,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:18,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:18,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:18,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,400 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:18,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:18,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:18,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:18,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:18,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:18,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:18,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:18,402 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:18,402 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:18,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:18,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:18,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:18,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:18,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:18,403 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:18,823 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a422c1aff6bc4d92b511e3a2655433a5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a422c1aff6bc4d92b511e3a2655433a5 2023-11-08 22:53:19,231 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/ace4edb5021c4065993e950e4dfcbda0 2023-11-08 22:53:19,244 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/ace4edb5021c4065993e950e4dfcbda0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0 2023-11-08 22:53:19,250 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0, entries=1, sequenceid=17, filesize=4.9 K 2023-11-08 22:53:19,251 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 848ms, sequenceid=17, compaction requested=true 2023-11-08 22:53:19,251 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:19,251 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:19,251 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:19,251 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:19,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:19,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:19,253 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,253 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:19,254 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:19,254 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:19,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:19,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:19,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51dd1dc8[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:19,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:19,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,258 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,258 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:19,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:19,259 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,259 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:19,260 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,260 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:19,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:19,260 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:19,260 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:19,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:19,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:19,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:19,265 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:19,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:19,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:19,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,265 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:19,273 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,273 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,273 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:19,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:19,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:19,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:19,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,277 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:19,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:19,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,283 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:19,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:19,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:19,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:19,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:19,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:19,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:19,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,284 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:19,284 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:19,284 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:19,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:19,284 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,384 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:19,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:19,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:19,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:19,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,401 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:19,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:19,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:19,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:19,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,404 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:19,404 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:19,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:19,405 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:19,405 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:19,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:19,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,407 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,408 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:19,408 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:19,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:19,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:19,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:19,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:19,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:19,409 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:19,409 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:19,409 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:19,836 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283146e7b338cc4639a80769a5e0bc31ed to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283146e7b338cc4639a80769a5e0bc31ed 2023-11-08 22:53:19,955 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:53:20,244 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19 2023-11-08 22:53:20,258 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19 2023-11-08 22:53:20,264 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19, entries=1, sequenceid=21, filesize=4.9 K 2023-11-08 22:53:20,265 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 856ms, sequenceid=21, compaction requested=true 2023-11-08 22:53:20,265 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:20,265 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:20,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:20,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:20,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:20,265 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:20,267 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:20,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:20,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:20,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:20,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@474b8594[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:20,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:20,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,271 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:20,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:20,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:20,271 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,272 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:20,273 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:20,273 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:20,273 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:20,273 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:20,276 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:20,276 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:20,276 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:20,276 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:20,276 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,276 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:20,277 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,277 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,277 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:20,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:20,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:20,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,282 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:20,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:20,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:20,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:20,282 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,282 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:20,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:20,283 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:20,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:20,383 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:20,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:20,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,396 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:20,397 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:20,397 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:20,397 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:20,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,399 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:20,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:20,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:20,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:20,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:20,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:20,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,404 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:20,404 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:20,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:20,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:20,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:20,405 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:20,405 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:20,405 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:20,405 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:20,405 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:20,833 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231484e0bf09ba14a4e86267c5061ee5eb8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231484e0bf09ba14a4e86267c5061ee5eb8 2023-11-08 22:53:21,246 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/3e05f2c2c3f343e88757cd665e1b1552 2023-11-08 22:53:21,255 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/3e05f2c2c3f343e88757cd665e1b1552 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552 2023-11-08 22:53:21,261 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552, entries=1, sequenceid=25, filesize=4.9 K 2023-11-08 22:53:21,262 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 857ms, sequenceid=25, compaction requested=true 2023-11-08 22:53:21,262 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:21,262 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:21,262 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:21,262 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:21,262 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,262 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:21,262 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:21,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,264 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:21,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,264 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:21,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:21,266 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3036edff[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:21,266 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:21,266 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,267 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:21,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:21,267 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,267 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:21,267 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:21,268 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:21,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:21,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:21,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:21,270 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:21,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:21,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:21,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:21,270 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,270 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:21,271 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,271 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,272 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:21,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:21,272 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:21,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:21,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:21,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:21,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:21,275 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:21,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:21,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:21,275 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:21,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:21,376 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:21,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:21,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:21,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:21,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,382 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:21,382 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:21,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:21,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:21,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,383 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,384 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:21,384 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:21,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:21,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:21,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:21,385 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:21,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,386 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,386 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:21,386 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:21,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:21,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:21,387 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:21,387 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:21,387 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:21,814 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101d5f9fc435cf2451ca472477331bce3b1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d5f9fc435cf2451ca472477331bce3b1 2023-11-08 22:53:22,223 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/808dbf380d18404782cb9fe8f1c98600 2023-11-08 22:53:22,237 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/808dbf380d18404782cb9fe8f1c98600 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600 2023-11-08 22:53:22,246 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600, entries=1, sequenceid=29, filesize=4.9 K 2023-11-08 22:53:22,248 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 861ms, sequenceid=29, compaction requested=true 2023-11-08 22:53:22,248 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:22,248 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:22,248 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:22,248 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:22,248 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:22,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:22,251 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,251 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:22,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:22,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f566bcd[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:22,255 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:22,255 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:22,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:22,256 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:22,256 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,256 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:22,258 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:22,259 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:22,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:22,262 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:22,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:22,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:22,262 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,262 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:22,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:22,283 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,286 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,291 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:22,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:22,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:22,291 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:22,292 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:22,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:22,292 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:22,292 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:22,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:22,392 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:22,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:22,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:22,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:22,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,409 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:22,409 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:22,409 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:22,409 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:22,410 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,410 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,412 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:22,412 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:22,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:22,413 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,413 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:22,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:22,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,415 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,415 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:22,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:22,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:22,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:22,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:22,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:22,416 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:22,416 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:22,416 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:22,439 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035e2c7ab2f1d740bb835670fb7b653a47 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035e2c7ab2f1d740bb835670fb7b653a47 2023-11-08 22:53:22,446 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/a442f886a04e4f88a0451a49daf02b0f 2023-11-08 22:53:22,452 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/a442f886a04e4f88a0451a49daf02b0f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f 2023-11-08 22:53:22,459 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f, entries=1, sequenceid=33, filesize=4.9 K 2023-11-08 22:53:22,460 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 44ms, sequenceid=33, compaction requested=true 2023-11-08 22:53:22,460 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:22,460 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:22,460 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:22,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:22,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:22,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:22,463 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,463 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:22,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:22,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@265c16b2[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:22,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:22,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,467 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,467 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:22,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:22,468 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:22,468 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,468 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:22,469 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:22,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:22,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:22,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:22,474 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:22,474 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:22,474 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:22,474 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:22,475 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,475 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:22,477 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,477 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,477 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:22,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:22,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:22,478 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:22,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:22,490 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,490 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:22,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:22,490 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:22,491 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:22,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:22,491 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:22,491 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,492 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:22,492 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,492 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,592 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:22,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:22,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:22,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:22,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,608 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:22,608 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:22,608 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:22,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:22,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,611 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:22,611 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:22,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:22,612 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:22,612 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:22,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,613 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,614 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:22,614 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:22,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:22,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:22,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:22,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:22,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:22,615 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:22,615 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:22,615 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:23,039 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509075b7af364af2541088f3ce0b57470b7d6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201509075b7af364af2541088f3ce0b57470b7d6 2023-11-08 22:53:23,447 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/cc76fa60b8454c6b83ddcb47c6192656 2023-11-08 22:53:23,453 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/cc76fa60b8454c6b83ddcb47c6192656 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656 2023-11-08 22:53:23,458 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656, entries=1, sequenceid=37, filesize=4.9 K 2023-11-08 22:53:23,459 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 844ms, sequenceid=37, compaction requested=true 2023-11-08 22:53:23,459 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:23,459 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:23,459 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:23,459 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:23,459 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,459 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:23,459 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:23,461 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,461 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:23,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:23,462 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,462 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:23,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:23,463 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d2040c8[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:23,463 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:23,463 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:23,464 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:23,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,465 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:23,465 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,465 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:23,465 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:23,466 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:23,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:23,468 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:23,468 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:23,468 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:23,468 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,468 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:23,470 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,470 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:23,470 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:23,470 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:23,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,471 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:23,473 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:23,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:23,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:23,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,473 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:23,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:23,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:23,474 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:23,574 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:23,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:23,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:23,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:23,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,586 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:23,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:23,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:23,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:23,587 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,587 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,589 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:23,589 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:23,590 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:23,590 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:23,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,591 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:23,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,591 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,592 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:23,592 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:23,592 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:23,592 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:23,592 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:23,592 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:23,592 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:23,592 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:23,592 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. started... 2023-11-08 22:53:23,592 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 347fa17718a32e5504a20f4e076a1544 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:24,012 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c9ee5659a8ce4a09a1387d61bfcd82a3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120c9ee5659a8ce4a09a1387d61bfcd82a3 2023-11-08 22:53:24,419 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/05a521aca19c4112b89ded1267c06f71 2023-11-08 22:53:24,432 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/05a521aca19c4112b89ded1267c06f71 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71 2023-11-08 22:53:24,441 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71, entries=1, sequenceid=41, filesize=4.9 K 2023-11-08 22:53:24,442 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 347fa17718a32e5504a20f4e076a1544 in 850ms, sequenceid=41, compaction requested=true 2023-11-08 22:53:24,443 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:24,443 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:24,443 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:24,443 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:24,443 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,443 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:24,443 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:24,447 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,448 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:24,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:24,448 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,449 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:24,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:24,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:24,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:24,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3afe1b86[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:24,452 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:24,453 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,456 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,456 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:24,456 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:24,456 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:24,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,457 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:24,457 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:24,457 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,457 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:24,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:24,458 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:24,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:24,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:24,460 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:24,460 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:24,460 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:24,460 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,460 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:24,461 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,461 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:24,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,461 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:24,461 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:24,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:24,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,462 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:24,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-08 22:53:24,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:24,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:24,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:24,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:24,465 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:24,464 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:24,465 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:24,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:24,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:24,465 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,465 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,465 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,565 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:24,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:24,570 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-08 22:53:24,573 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:24,574 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:24,576 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484604576 2023-11-08 22:53:24,576 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:24,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:53:24,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-08 22:53:24,582 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:24,584 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x02d025f0 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:24,589 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@520f4f10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:24,589 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,450 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033eb41b55943248eda6753ebd85279950 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601033eb41b55943248eda6753ebd85279950 2023-11-08 22:53:25,451 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:25,462 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:25,463 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43378, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:25,469 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:25,471 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:25,480 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e495c5ad258c4a929849178964298032 first=Optional[r3] last=Optional[r6] 2023-11-08 22:53:25,480 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e495c5ad258c4a929849178964298032}] 2023-11-08 22:53:25,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e495c5ad258c4a929849178964298032 for inclusion in 347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:25,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-08 22:53:25,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:25,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:25,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e495c5ad258c4a929849178964298032 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8pj96pprhivudsj1dlrq9ck77f0mhn06i6taogo0n17iksm197uq0q58eqc5st5k/family1/e495c5ad258c4a929849178964298032 2023-11-08 22:53:25,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8pj96pprhivudsj1dlrq9ck77f0mhn06i6taogo0n17iksm197uq0q58eqc5st5k/family1/e495c5ad258c4a929849178964298032 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_ 2023-11-08 22:53:25,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8pj96pprhivudsj1dlrq9ck77f0mhn06i6taogo0n17iksm197uq0q58eqc5st5k/family1/e495c5ad258c4a929849178964298032 into 347fa17718a32e5504a20f4e076a1544/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_ - updating store file list. 2023-11-08 22:53:25,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_ into 347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:25,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8pj96pprhivudsj1dlrq9ck77f0mhn06i6taogo0n17iksm197uq0q58eqc5st5k/family1/e495c5ad258c4a929849178964298032 into 347fa17718a32e5504a20f4e076a1544/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_) 2023-11-08 22:53:25,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__8pj96pprhivudsj1dlrq9ck77f0mhn06i6taogo0n17iksm197uq0q58eqc5st5k/family1/e495c5ad258c4a929849178964298032 2023-11-08 22:53:25,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:53:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:53:25,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 347fa17718a32e5504a20f4e076a1544/family1 is initiating minor compaction 2023-11-08 22:53:25,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@794f2e6b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:25,504 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 347fa17718a32e5504a20f4e076a1544/family1 in testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:53:25,504 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp, totalSize=50.0 K 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting e2aedb678dbf41809142d7518d89ac0c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting d3636e4a9a5b44c79efa6216f30af844, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting ace4edb5021c4065993e950e4dfcbda0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting cc9e6cd9f3b94e3abcfbe7c0d6442f19, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 3e05f2c2c3f343e88757cd665e1b1552, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:53:25,504 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 808dbf380d18404782cb9fe8f1c98600, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:53:25,505 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a442f886a04e4f88a0451a49daf02b0f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:53:25,505 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting cc76fa60b8454c6b83ddcb47c6192656, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:53:25,505 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 05a521aca19c4112b89ded1267c06f71, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:53:25,505 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:53:25,506 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:25,507 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:25,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283146e7b338cc4639a80769a5e0bc31ed to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512283146e7b338cc4639a80769a5e0bc31ed 2023-11-08 22:53:25,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231484e0bf09ba14a4e86267c5061ee5eb8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231484e0bf09ba14a4e86267c5061ee5eb8 2023-11-08 22:53:25,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d5f9fc435cf2451ca472477331bce3b1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101d5f9fc435cf2451ca472477331bce3b1 2023-11-08 22:53:25,512 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035e2c7ab2f1d740bb835670fb7b653a47 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601035e2c7ab2f1d740bb835670fb7b653a47 2023-11-08 22:53:25,512 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-08 22:53:25,512 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,513 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,531 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 347fa17718a32e5504a20f4e076a1544#family1#compaction#34 average throughput is 1.36 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:25,547 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205919acbeb1fba4886832b6cca35653ccc to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205919acbeb1fba4886832b6cca35653ccc 2023-11-08 22:53:25,548 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:25,571 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/41b09740ab6c408f9a1a26d531154558 first=Optional[r1] last=Optional[r2] 2023-11-08 22:53:25,572 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/41b09740ab6c408f9a1a26d531154558}] 2023-11-08 22:53:25,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/41b09740ab6c408f9a1a26d531154558 for inclusion in 347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:25,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-08 22:53:25,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:25,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:25,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/41b09740ab6c408f9a1a26d531154558 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ivkge5obcu8b72ddes5msp4soc44jc1t5c78disci082mpd1bt86lqg4t7ufsvh0/family1/41b09740ab6c408f9a1a26d531154558 2023-11-08 22:53:25,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ivkge5obcu8b72ddes5msp4soc44jc1t5c78disci082mpd1bt86lqg4t7ufsvh0/family1/41b09740ab6c408f9a1a26d531154558 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cca2fece19114a4c9a5a84132f06fef8_SeqId_46_ 2023-11-08 22:53:25,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ivkge5obcu8b72ddes5msp4soc44jc1t5c78disci082mpd1bt86lqg4t7ufsvh0/family1/41b09740ab6c408f9a1a26d531154558 into 347fa17718a32e5504a20f4e076a1544/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cca2fece19114a4c9a5a84132f06fef8_SeqId_46_ - updating store file list. 2023-11-08 22:53:25,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cca2fece19114a4c9a5a84132f06fef8_SeqId_46_ into 347fa17718a32e5504a20f4e076a1544/family1 2023-11-08 22:53:25,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ivkge5obcu8b72ddes5msp4soc44jc1t5c78disci082mpd1bt86lqg4t7ufsvh0/family1/41b09740ab6c408f9a1a26d531154558 into 347fa17718a32e5504a20f4e076a1544/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cca2fece19114a4c9a5a84132f06fef8_SeqId_46_) 2023-11-08 22:53:25,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithWeeklyPolicy__ivkge5obcu8b72ddes5msp4soc44jc1t5c78disci082mpd1bt86lqg4t7ufsvh0/family1/41b09740ab6c408f9a1a26d531154558 2023-11-08 22:53:25,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:25,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:25,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3f18bccc2df4aad8347e4dde46942ac to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201f3f18bccc2df4aad8347e4dde46942ac 2023-11-08 22:53:25,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a422c1aff6bc4d92b511e3a2655433a5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205a422c1aff6bc4d92b511e3a2655433a5 2023-11-08 22:53:25,596 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-08 22:53:25,596 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-08 22:53:25,596 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:25,596 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:25,596 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:25,597 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:25,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0260 sec 2023-11-08 22:53:25,724 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 264), OpenFileDescriptor=654 (was 644) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 268), ProcessCount=167 (was 169), AvailableMemoryMB=6455 (was 6516) 2023-11-08 22:53:25,733 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=167, AvailableMemoryMB=6454 2023-11-08 22:53:25,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-08 22:53:25,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:25,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:25,739 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-08 22:53:25,739 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:25,741 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:25,741 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:25,741 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:25,742 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746 empty. 2023-11-08 22:53:25,742 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2 empty. 2023-11-08 22:53:25,742 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148 empty. 2023-11-08 22:53:25,743 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:25,743 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:25,743 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:25,743 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-08 22:53:25,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:25,957 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/.tmp/family1/232cd7ee556b41078e8bbd380f81895b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/232cd7ee556b41078e8bbd380f81895b 2023-11-08 22:53:25,964 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 347fa17718a32e5504a20f4e076a1544/family1 of 347fa17718a32e5504a20f4e076a1544 into 232cd7ee556b41078e8bbd380f81895b(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:25,964 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:53:25,965 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699484005503; duration=0sec 2023-11-08 22:53:25,965 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:26,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_] to archive 2023-11-08 22:53:26,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:26,012 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/e2aedb678dbf41809142d7518d89ac0c 2023-11-08 22:53:26,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/d3636e4a9a5b44c79efa6216f30af844 2023-11-08 22:53:26,014 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/ace4edb5021c4065993e950e4dfcbda0 2023-11-08 22:53:26,015 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc9e6cd9f3b94e3abcfbe7c0d6442f19 2023-11-08 22:53:26,017 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/3e05f2c2c3f343e88757cd665e1b1552 2023-11-08 22:53:26,018 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/808dbf380d18404782cb9fe8f1c98600 2023-11-08 22:53:26,019 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/a442f886a04e4f88a0451a49daf02b0f 2023-11-08 22:53:26,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/cc76fa60b8454c6b83ddcb47c6192656 2023-11-08 22:53:26,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/05a521aca19c4112b89ded1267c06f71 2023-11-08 22:53:26,023 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/family1/bf4efd7fc1124cb783a3e9573d755e66_SeqId_44_ 2023-11-08 22:53:26,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:26,153 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:26,155 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => dea4bbdb137840aca8ee60f38afde148, NAME => 'testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:26,155 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => be285d07f34d3de681967a49a8d0fcd2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:26,156 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4205e8d3ee75e530a59b15fc7e63f746, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:26,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:26,570 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing be285d07f34d3de681967a49a8d0fcd2, disabling compactions & flushes 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 4205e8d3ee75e530a59b15fc7e63f746, disabling compactions & flushes 2023-11-08 22:53:26,571 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,571 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing dea4bbdb137840aca8ee60f38afde148, disabling compactions & flushes 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,571 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,571 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. after waiting 0 ms 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. after waiting 0 ms 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,572 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for dea4bbdb137840aca8ee60f38afde148: 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. after waiting 0 ms 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,572 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,572 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,572 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:26,573 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 4205e8d3ee75e530a59b15fc7e63f746: 2023-11-08 22:53:26,577 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:53:26,578 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484006578"}]},"ts":"1699484006578"} 2023-11-08 22:53:26,579 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484006578"}]},"ts":"1699484006578"} 2023-11-08 22:53:26,579 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699484006578"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484006578"}]},"ts":"1699484006578"} 2023-11-08 22:53:26,583 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-08 22:53:26,583 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:53:26,584 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484006584"}]},"ts":"1699484006584"} 2023-11-08 22:53:26,585 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-08 22:53:26,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea4bbdb137840aca8ee60f38afde148, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4205e8d3ee75e530a59b15fc7e63f746, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be285d07f34d3de681967a49a8d0fcd2, ASSIGN}] 2023-11-08 22:53:26,590 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be285d07f34d3de681967a49a8d0fcd2, ASSIGN 2023-11-08 22:53:26,590 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4205e8d3ee75e530a59b15fc7e63f746, ASSIGN 2023-11-08 22:53:26,590 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea4bbdb137840aca8ee60f38afde148, ASSIGN 2023-11-08 22:53:26,590 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4205e8d3ee75e530a59b15fc7e63f746, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:26,590 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be285d07f34d3de681967a49a8d0fcd2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:26,590 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea4bbdb137840aca8ee60f38afde148, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:26,743 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4205e8d3ee75e530a59b15fc7e63f746, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,743 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dea4bbdb137840aca8ee60f38afde148, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,743 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=be285d07f34d3de681967a49a8d0fcd2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,744 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699484006743"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484006743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484006743"}]},"ts":"1699484006743"} 2023-11-08 22:53:26,744 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006743"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484006743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484006743"}]},"ts":"1699484006743"} 2023-11-08 22:53:26,744 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006743"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484006743"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484006743"}]},"ts":"1699484006743"} 2023-11-08 22:53:26,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4205e8d3ee75e530a59b15fc7e63f746, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:26,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure dea4bbdb137840aca8ee60f38afde148, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:26,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure be285d07f34d3de681967a49a8d0fcd2, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:26,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:26,903 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => be285d07f34d3de681967a49a8d0fcd2, NAME => 'testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.', STARTKEY => '2', ENDKEY => ''} 2023-11-08 22:53:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,912 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,915 DEBUG [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1 2023-11-08 22:53:26,915 DEBUG [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1 2023-11-08 22:53:26,916 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be285d07f34d3de681967a49a8d0fcd2 columnFamilyName family1 2023-11-08 22:53:26,918 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] regionserver.HStore(310): Store=be285d07f34d3de681967a49a8d0fcd2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,918 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,920 DEBUG [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family2 2023-11-08 22:53:26,920 DEBUG [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family2 2023-11-08 22:53:26,920 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region be285d07f34d3de681967a49a8d0fcd2 columnFamilyName family2 2023-11-08 22:53:26,921 INFO [StoreOpener-be285d07f34d3de681967a49a8d0fcd2-1] regionserver.HStore(310): Store=be285d07f34d3de681967a49a8d0fcd2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:53:26,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:53:26,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:26,928 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened be285d07f34d3de681967a49a8d0fcd2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64194230, jitterRate=-0.04343143105506897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:53:26,928 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:26,929 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2., pid=33, masterSystemTime=1699484006902 2023-11-08 22:53:26,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:26,930 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,930 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dea4bbdb137840aca8ee60f38afde148, NAME => 'testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.', STARTKEY => '', ENDKEY => '1'} 2023-11-08 22:53:26,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=be285d07f34d3de681967a49a8d0fcd2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006931"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484006931"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484006931"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484006931"}]},"ts":"1699484006931"} 2023-11-08 22:53:26,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,932 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-11-08 22:53:26,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure be285d07f34d3de681967a49a8d0fcd2, server=jenkins-hbase20.apache.org,35543,1699483966133 in 181 msec 2023-11-08 22:53:26,934 DEBUG [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/family1 2023-11-08 22:53:26,934 DEBUG [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/family1 2023-11-08 22:53:26,935 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea4bbdb137840aca8ee60f38afde148 columnFamilyName family1 2023-11-08 22:53:26,935 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=be285d07f34d3de681967a49a8d0fcd2, ASSIGN in 346 msec 2023-11-08 22:53:26,936 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] regionserver.HStore(310): Store=dea4bbdb137840aca8ee60f38afde148/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,936 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,937 DEBUG [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/family2 2023-11-08 22:53:26,937 DEBUG [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/family2 2023-11-08 22:53:26,938 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dea4bbdb137840aca8ee60f38afde148 columnFamilyName family2 2023-11-08 22:53:26,939 INFO [StoreOpener-dea4bbdb137840aca8ee60f38afde148-1] regionserver.HStore(310): Store=dea4bbdb137840aca8ee60f38afde148/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:53:26,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:53:26,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:26,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened dea4bbdb137840aca8ee60f38afde148; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74719891, jitterRate=0.11341314017772675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:53:26,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for dea4bbdb137840aca8ee60f38afde148: 2023-11-08 22:53:26,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148., pid=32, masterSystemTime=1699484006902 2023-11-08 22:53:26,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:26,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4205e8d3ee75e530a59b15fc7e63f746, NAME => 'testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.', STARTKEY => '1', ENDKEY => '2'} 2023-11-08 22:53:26,948 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=dea4bbdb137840aca8ee60f38afde148, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,949 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1699484006948"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484006948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484006948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484006948"}]},"ts":"1699484006948"} 2023-11-08 22:53:26,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:26,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,949 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,951 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-11-08 22:53:26,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure dea4bbdb137840aca8ee60f38afde148, server=jenkins-hbase20.apache.org,35543,1699483966133 in 201 msec 2023-11-08 22:53:26,952 DEBUG [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/family1 2023-11-08 22:53:26,952 DEBUG [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/family1 2023-11-08 22:53:26,953 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4205e8d3ee75e530a59b15fc7e63f746 columnFamilyName family1 2023-11-08 22:53:26,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=dea4bbdb137840aca8ee60f38afde148, ASSIGN in 364 msec 2023-11-08 22:53:26,954 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] regionserver.HStore(310): Store=4205e8d3ee75e530a59b15fc7e63f746/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,954 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,955 DEBUG [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/family2 2023-11-08 22:53:26,956 DEBUG [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/family2 2023-11-08 22:53:26,956 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4205e8d3ee75e530a59b15fc7e63f746 columnFamilyName family2 2023-11-08 22:53:26,957 INFO [StoreOpener-4205e8d3ee75e530a59b15fc7e63f746-1] regionserver.HStore(310): Store=4205e8d3ee75e530a59b15fc7e63f746/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:26,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:53:26,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:53:26,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:26,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4205e8d3ee75e530a59b15fc7e63f746; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74248314, jitterRate=0.10638609528541565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:53:26,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4205e8d3ee75e530a59b15fc7e63f746: 2023-11-08 22:53:26,966 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746., pid=31, masterSystemTime=1699484006902 2023-11-08 22:53:26,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:26,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4205e8d3ee75e530a59b15fc7e63f746, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:26,969 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1699484006968"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484006968"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484006968"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484006968"}]},"ts":"1699484006968"} 2023-11-08 22:53:26,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-11-08 22:53:26,973 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4205e8d3ee75e530a59b15fc7e63f746, server=jenkins-hbase20.apache.org,35543,1699483966133 in 223 msec 2023-11-08 22:53:26,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-11-08 22:53:26,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4205e8d3ee75e530a59b15fc7e63f746, ASSIGN in 384 msec 2023-11-08 22:53:26,975 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:53:26,976 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484006975"}]},"ts":"1699484006975"} 2023-11-08 22:53:26,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-08 22:53:26,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:53:26,981 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2440 sec 2023-11-08 22:53:27,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-08 22:53:27,850 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-08 22:53:27,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:27,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,863 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-08 22:53:27,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:27,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-08 22:53:27,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-08 22:53:27,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,865 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:27,865 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:27,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:27,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:27,866 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:27,866 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:27,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:27,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,867 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,867 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:27,867 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-08 22:53:27,867 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:27,867 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-08 22:53:27,867 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:27,867 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. started... 2023-11-08 22:53:27,867 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:27,867 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:53:27,868 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4205e8d3ee75e530a59b15fc7e63f746: 2023-11-08 22:53:27,868 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:27,868 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:27,868 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:53:27,868 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:27,868 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. started... 2023-11-08 22:53:27,867 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. started... 2023-11-08 22:53:27,869 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be285d07f34d3de681967a49a8d0fcd2 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-08 22:53:27,869 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dea4bbdb137840aca8ee60f38afde148: 2023-11-08 22:53:27,870 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:27,870 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:53:28,292 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311083e459d4f30f64d1da41d7d3df5618d42 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311083e459d4f30f64d1da41d7d3df5618d42 2023-11-08 22:53:28,300 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp/family1/ffd832971bbf48088debdf5b954984b2 2023-11-08 22:53:28,306 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp/family1/ffd832971bbf48088debdf5b954984b2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2 2023-11-08 22:53:28,313 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2, entries=1, sequenceid=5, filesize=4.9 K 2023-11-08 22:53:28,314 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for be285d07f34d3de681967a49a8d0fcd2 in 445ms, sequenceid=5, compaction requested=false 2023-11-08 22:53:28,314 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-08 22:53:28,314 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:28,314 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:28,314 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:53:28,314 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:53:28,314 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,314 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-08 22:53:28,314 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-08 22:53:28,326 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:28,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:28,327 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:28,327 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:28,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:28,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-08 22:53:28,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16da1717[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:28,329 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-08 22:53:28,329 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,329 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,330 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-08 22:53:28,330 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-08 22:53:28,330 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:28,330 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,330 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:28,331 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,331 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-08 22:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:28,331 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:28,331 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-08 22:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:28,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:28,333 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-08 22:53:28,333 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-08 22:53:28,333 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:28,333 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:28,333 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,334 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:28,335 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,335 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:28,335 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:28,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,336 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:28,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:28,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,338 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:28,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,348 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:28,348 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-08 22:53:28,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:28,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-08 22:53:28,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,348 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:28,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:28,349 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:28,349 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:28,449 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:28,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:28,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:28,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:28,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,464 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-08 22:53:28,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:28,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-08 22:53:28,464 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-08 22:53:28,465 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,465 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,466 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,466 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:28,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:28,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:28,467 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:28,467 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:28,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:28,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,468 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,469 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-08 22:53:28,469 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:28,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-08 22:53:28,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:28,469 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-08 22:53:28,469 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:28,469 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. started... 2023-11-08 22:53:28,470 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:53:28,470 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:28,469 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4205e8d3ee75e530a59b15fc7e63f746: 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. started... 2023-11-08 22:53:28,470 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for dea4bbdb137840aca8ee60f38afde148: 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:53:28,470 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. started... 2023-11-08 22:53:28,470 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:53:28,471 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing be285d07f34d3de681967a49a8d0fcd2 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-08 22:53:28,895 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311087c1938e5a6e343529a6fe6db58c219a9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311087c1938e5a6e343529a6fe6db58c219a9 2023-11-08 22:53:29,303 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp/family1/409cb25024814368b0a017d2690a0269 2023-11-08 22:53:29,313 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp/family1/409cb25024814368b0a017d2690a0269 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269 2023-11-08 22:53:29,319 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269, entries=2, sequenceid=9, filesize=5.0 K 2023-11-08 22:53:29,320 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for be285d07f34d3de681967a49a8d0fcd2 in 849ms, sequenceid=9, compaction requested=false 2023-11-08 22:53:29,320 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:29,320 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:29,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:53:29,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:53:29,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-08 22:53:29,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-08 22:53:29,322 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,322 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:29,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:29,323 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:29,323 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:29,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:29,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:29,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-08 22:53:29,324 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50757af8[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:29,324 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-08 22:53:29,324 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,325 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,325 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-08 22:53:29,325 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-08 22:53:29,326 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:29,326 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,326 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:29,327 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-08 22:53:29,327 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:29,327 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,327 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-08 22:53:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:29,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:29,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:29,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:29,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:29,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-08 22:53:29,330 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-08 22:53:29,330 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:29,330 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:29,330 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,330 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:29,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,332 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:29,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:29,333 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,335 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:29,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:29,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:29,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-08 22:53:29,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:29,340 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,340 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,341 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:29,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:29,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:29,341 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:29,441 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:29,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:29,455 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-08 22:53:29,457 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-08 22:53:29,457 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-08 22:53:29,458 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:29,458 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484609458 2023-11-08 22:53:29,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:29,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-08 22:53:29,459 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-08 22:53:29,461 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x5fabc0de to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:29,464 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777473f4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:29,464 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231108 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-08 22:53:30,302 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110806dfac132c2b48fe808eadeb1177f652 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023110806dfac132c2b48fe808eadeb1177f652 2023-11-08 22:53:30,304 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-08 22:53:30,317 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:30,318 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:30,326 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:30,329 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:30,340 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231108/family1/380333fc646d4f8ca04f57b677240f6f first=Optional[k0] last=Optional[k1] 2023-11-08 22:53:30,341 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231108/family1/380333fc646d4f8ca04f57b677240f6f}] 2023-11-08 22:53:30,347 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231108/family1/380333fc646d4f8ca04f57b677240f6f for inclusion in be285d07f34d3de681967a49a8d0fcd2/family1 2023-11-08 22:53:30,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-08 22:53:30,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-08 22:53:30,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:30,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231108/family1/380333fc646d4f8ca04f57b677240f6f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testScannerOnBulkLoadRefHFiles__hbljbpi4v9qj45hrbuoccs1tdqfg327t4nnb7699pi461t0hg86uk7q08f2nmut6/family1/380333fc646d4f8ca04f57b677240f6f 2023-11-08 22:53:30,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testScannerOnBulkLoadRefHFiles__hbljbpi4v9qj45hrbuoccs1tdqfg327t4nnb7699pi461t0hg86uk7q08f2nmut6/family1/380333fc646d4f8ca04f57b677240f6f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_ 2023-11-08 22:53:30,354 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testScannerOnBulkLoadRefHFiles__hbljbpi4v9qj45hrbuoccs1tdqfg327t4nnb7699pi461t0hg86uk7q08f2nmut6/family1/380333fc646d4f8ca04f57b677240f6f into be285d07f34d3de681967a49a8d0fcd2/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_ - updating store file list. 2023-11-08 22:53:30,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_ into be285d07f34d3de681967a49a8d0fcd2/family1 2023-11-08 22:53:30,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testScannerOnBulkLoadRefHFiles__hbljbpi4v9qj45hrbuoccs1tdqfg327t4nnb7699pi461t0hg86uk7q08f2nmut6/family1/380333fc646d4f8ca04f57b677240f6f into be285d07f34d3de681967a49a8d0fcd2/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_) 2023-11-08 22:53:30,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testScannerOnBulkLoadRefHFiles__hbljbpi4v9qj45hrbuoccs1tdqfg327t4nnb7699pi461t0hg86uk7q08f2nmut6/family1/380333fc646d4f8ca04f57b677240f6f 2023-11-08 22:53:30,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:53:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:53:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): be285d07f34d3de681967a49a8d0fcd2/family1 is initiating minor compaction (all files) 2023-11-08 22:53:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6fc02b5d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-08 22:53:30,360 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of be285d07f34d3de681967a49a8d0fcd2/family1 in testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:53:30,360 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp, totalSize=15.1 K 2023-11-08 22:53:30,361 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting ffd832971bbf48088debdf5b954984b2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484007851 2023-11-08 22:53:30,361 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 409cb25024814368b0a017d2690a0269, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484007851 2023-11-08 22:53:30,362 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484007851 2023-11-08 22:53:30,362 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-08 22:53:30,363 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:30,365 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311083e459d4f30f64d1da41d7d3df5618d42 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311083e459d4f30f64d1da41d7d3df5618d42 2023-11-08 22:53:30,366 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311087c1938e5a6e343529a6fe6db58c219a9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202311087c1938e5a6e343529a6fe6db58c219a9 2023-11-08 22:53:30,366 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-08 22:53:30,366 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231108' 2023-11-08 22:53:30,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231108 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-08 22:53:30,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-08 22:53:30,367 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:30,368 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-08 22:53:30,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 912 msec 2023-11-08 22:53:30,373 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): be285d07f34d3de681967a49a8d0fcd2#family1#compaction#37 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:30,409 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=654 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=241 (was 241), ProcessCount=167 (was 167), AvailableMemoryMB=6415 (was 6454) 2023-11-08 22:53:30,419 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=241, ProcessCount=167, AvailableMemoryMB=6415 2023-11-08 22:53:30,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:53:30,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:30,424 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:30,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-08 22:53:30,425 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:30,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:30,426 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:30,427 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452 empty. 2023-11-08 22:53:30,427 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:30,427 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-08 22:53:30,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:30,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:30,839 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:30,843 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6cb330d61b75b359b9996b134426452, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:31,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:31,211 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/.tmp/family1/a68cba3a96bc47fab6424297ffc0539f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/a68cba3a96bc47fab6424297ffc0539f 2023-11-08 22:53:31,217 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in be285d07f34d3de681967a49a8d0fcd2/family1 of be285d07f34d3de681967a49a8d0fcd2 into a68cba3a96bc47fab6424297ffc0539f(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:31,217 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:53:31,217 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1699484010360; duration=0sec 2023-11-08 22:53:31,217 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:31,251 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:31,251 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing c6cb330d61b75b359b9996b134426452, disabling compactions & flushes 2023-11-08 22:53:31,251 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,252 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,252 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. after waiting 0 ms 2023-11-08 22:53:31,252 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,252 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,252 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:31,256 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:53:31,258 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699484011257"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484011257"}]},"ts":"1699484011257"} 2023-11-08 22:53:31,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:53:31,262 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:53:31,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484011262"}]},"ts":"1699484011262"} 2023-11-08 22:53:31,263 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-08 22:53:31,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c6cb330d61b75b359b9996b134426452, ASSIGN}] 2023-11-08 22:53:31,268 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c6cb330d61b75b359b9996b134426452, ASSIGN 2023-11-08 22:53:31,269 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c6cb330d61b75b359b9996b134426452, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:31,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_] to archive 2023-11-08 22:53:31,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:31,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/ffd832971bbf48088debdf5b954984b2 2023-11-08 22:53:31,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/409cb25024814368b0a017d2690a0269 2023-11-08 22:53:31,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/family1/8a79dbfdb8844cbebd1667b4f5da9725_SeqId_12_ 2023-11-08 22:53:31,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c6cb330d61b75b359b9996b134426452, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:31,422 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699484011421"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484011421"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484011421"}]},"ts":"1699484011421"} 2023-11-08 22:53:31,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure c6cb330d61b75b359b9996b134426452, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:31,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:31,577 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:31,582 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6cb330d61b75b359b9996b134426452, NAME => 'testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,583 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,585 INFO [StoreOpener-c6cb330d61b75b359b9996b134426452-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,587 DEBUG [StoreOpener-c6cb330d61b75b359b9996b134426452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:31,588 DEBUG [StoreOpener-c6cb330d61b75b359b9996b134426452-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:31,588 INFO [StoreOpener-c6cb330d61b75b359b9996b134426452-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6cb330d61b75b359b9996b134426452 columnFamilyName family1 2023-11-08 22:53:31,591 INFO [StoreOpener-c6cb330d61b75b359b9996b134426452-1] regionserver.HStore(310): Store=c6cb330d61b75b359b9996b134426452/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:31,592 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c6cb330d61b75b359b9996b134426452 2023-11-08 22:53:31,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:31,601 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c6cb330d61b75b359b9996b134426452; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72467949, jitterRate=0.07985658943653107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:31,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:31,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452., pid=37, masterSystemTime=1699484011577 2023-11-08 22:53:31,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:31,604 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=c6cb330d61b75b359b9996b134426452, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:31,604 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1699484011604"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484011604"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484011604"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484011604"}]},"ts":"1699484011604"} 2023-11-08 22:53:31,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-11-08 22:53:31,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure c6cb330d61b75b359b9996b134426452, server=jenkins-hbase20.apache.org,35543,1699483966133 in 181 msec 2023-11-08 22:53:31,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-11-08 22:53:31,609 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=c6cb330d61b75b359b9996b134426452, ASSIGN in 340 msec 2023-11-08 22:53:31,609 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:53:31,609 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484011609"}]},"ts":"1699484011609"} 2023-11-08 22:53:31,610 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-08 22:53:31,612 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:53:31,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1910 sec 2023-11-08 22:53:31,954 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:53:31,954 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d413525 to 127.0.0.1:56299 2023-11-08 22:53:31,954 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:53:31,958 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:53:31,958 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x518755d2 to 127.0.0.1:56299 2023-11-08 22:53:31,958 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:53:31,961 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:53:31,961 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21f53dbd to 127.0.0.1:56299 2023-11-08 22:53:31,961 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:53:31,961 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:53:31,961 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fabc0de to 127.0.0.1:56299 2023-11-08 22:53:31,961 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:53:31,962 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:53:31,962 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02d025f0 to 127.0.0.1:56299 2023-11-08 22:53:31,962 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:53:32,472 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:53:32,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-08 22:53:32,535 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-08 22:53:32,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:32,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,563 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:32,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:32,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:32,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:32,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,565 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:32,565 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:32,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:32,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:32,565 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:32,565 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:32,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:32,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:32,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:32,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:32,567 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:32,567 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:32,567 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:32,567 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:53:32,986 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ff06c17097d24dfe80c8b0c408e030f3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130ff06c17097d24dfe80c8b0c408e030f3 2023-11-08 22:53:33,391 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/6fdec32cb710487e9df1a65bf0d39eb9 2023-11-08 22:53:33,402 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/6fdec32cb710487e9df1a65bf0d39eb9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/6fdec32cb710487e9df1a65bf0d39eb9 2023-11-08 22:53:33,409 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/6fdec32cb710487e9df1a65bf0d39eb9, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-08 22:53:33,410 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 843ms, sequenceid=5, compaction requested=false 2023-11-08 22:53:33,410 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:33,411 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:33,411 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:33,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:33,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:33,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:33,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:33,413 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:33,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:33,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6fec563e[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:33,415 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:33,415 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,416 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:33,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:33,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:33,416 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,416 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:33,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:33,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:33,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:33,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:33,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:33,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:33,419 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:33,419 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:33,419 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:33,419 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,419 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:33,420 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,420 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:33,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,420 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:33,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:33,421 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:33,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,422 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:33,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,425 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:33,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:33,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,426 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,426 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:33,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:33,426 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:33,426 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:33,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:33,526 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:33,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:33,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:33,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:33,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,540 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:33,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:33,541 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:33,541 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:33,542 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,542 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,544 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:33,544 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:33,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:33,545 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:33,545 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:33,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:33,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,548 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,548 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:33,548 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:33,548 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:33,548 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:33,548 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:33,549 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:33,549 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:33,549 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:33,549 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:33,549 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:53:33,978 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128102d4ee5a75a45a1b6fb19fe406a75ee to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128102d4ee5a75a45a1b6fb19fe406a75ee 2023-11-08 22:53:34,388 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/1524afc44bb74479b554067a633491bf 2023-11-08 22:53:34,401 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/1524afc44bb74479b554067a633491bf as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf 2023-11-08 22:53:34,408 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:53:34,409 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 860ms, sequenceid=9, compaction requested=false 2023-11-08 22:53:34,410 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:34,410 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:34,410 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:34,410 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:34,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:34,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,413 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:34,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,413 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:34,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:34,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:34,415 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:34,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2504426e[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:34,416 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:34,416 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:34,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:34,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:34,417 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,417 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:34,419 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:34,419 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:34,419 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:34,419 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:34,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:34,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:34,423 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:34,423 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:34,423 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:34,423 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,423 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:34,440 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,440 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,440 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:34,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:34,442 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:34,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,445 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,450 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:34,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:34,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:34,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:34,451 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:34,450 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,451 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,451 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,451 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:34,451 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:34,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:34,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:34,551 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:34,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:34,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:34,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:34,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,563 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:34,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:34,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:34,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:34,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,564 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:34,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:34,565 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:34,565 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,565 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,565 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,566 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:34,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:34,566 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:34,566 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:34,566 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:34,566 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:34,988 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201176803951554402fb39c288108a9c46f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201176803951554402fb39c288108a9c46f 2023-11-08 22:53:34,994 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/e5c4586501f5470f8a6204e090ade50d 2023-11-08 22:53:35,001 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/e5c4586501f5470f8a6204e090ade50d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d 2023-11-08 22:53:35,007 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d, entries=1, sequenceid=13, filesize=4.9 K 2023-11-08 22:53:35,009 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 443ms, sequenceid=13, compaction requested=true 2023-11-08 22:53:35,009 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:35,009 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:35,009 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:35,009 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:35,009 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,009 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:35,009 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:35,011 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:35,011 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,011 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:35,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:35,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63a08b76[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:35,012 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:35,013 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,013 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,013 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:35,013 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:35,013 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:35,014 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,014 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:35,014 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:35,014 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:35,014 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:35,014 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:35,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:35,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:35,017 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:35,017 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:35,017 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:35,017 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,017 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:35,018 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,018 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:35,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,018 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:35,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:35,019 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,020 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,021 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:35,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:35,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:35,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:35,021 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:35,022 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,022 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:35,022 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:35,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:35,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:35,122 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:35,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:35,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:35,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:35,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,134 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:35,134 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:35,134 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:35,134 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:35,135 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,135 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,137 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,137 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:35,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:35,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:35,137 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,137 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:35,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:35,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,140 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,140 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:35,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,140 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:35,140 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:35,141 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:35,141 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:35,141 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:35,141 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:35,141 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:35,141 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:35,569 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054cc146b28ca145a28ce708d5d0c832f3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054cc146b28ca145a28ce708d5d0c832f3 2023-11-08 22:53:35,976 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/bb125f3470d141669d277692b0f8304e 2023-11-08 22:53:35,987 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/bb125f3470d141669d277692b0f8304e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e 2023-11-08 22:53:35,992 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e, entries=1, sequenceid=17, filesize=4.9 K 2023-11-08 22:53:35,993 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 852ms, sequenceid=17, compaction requested=true 2023-11-08 22:53:35,993 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:35,993 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:35,993 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:35,993 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:35,993 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,993 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:35,993 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:35,994 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:35,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,995 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:35,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:35,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:35,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:35,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18f98f40[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:35,997 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:35,997 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:35,999 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:35,999 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:35,999 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:35,999 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:35,999 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:36,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:36,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:36,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:36,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:36,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:36,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:36,004 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:36,004 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:36,004 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:36,004 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,004 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:36,005 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,005 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,005 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:36,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:36,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:36,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:36,006 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:36,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:36,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:36,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,008 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,010 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,010 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,010 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:36,010 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,011 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:36,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:36,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:36,011 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:36,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:36,011 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:36,112 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:36,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:36,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:36,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:36,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,123 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:36,123 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:36,123 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:36,123 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:36,124 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,124 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,126 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:36,126 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:36,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:36,127 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,127 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:36,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:36,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,129 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:36,129 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,129 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:36,130 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:36,130 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:36,130 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:36,130 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:36,130 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:36,130 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:36,130 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:36,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f1847164e2d140feb137f96186afdf07 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f1847164e2d140feb137f96186afdf07 2023-11-08 22:53:36,968 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/155b0124cfc147aa8eec0ce1134fb865 2023-11-08 22:53:36,980 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/155b0124cfc147aa8eec0ce1134fb865 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865 2023-11-08 22:53:36,987 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865, entries=1, sequenceid=21, filesize=4.9 K 2023-11-08 22:53:36,988 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 858ms, sequenceid=21, compaction requested=true 2023-11-08 22:53:36,988 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:36,988 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:36,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:36,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:36,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:36,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:36,990 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,990 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:36,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:36,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:36,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@152977c7[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:36,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:36,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,997 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:36,998 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:36,998 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:36,998 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:36,998 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:36,998 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:37,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:37,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:37,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:37,000 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:37,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:37,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:37,006 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:37,006 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:37,006 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:37,006 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:37,006 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,006 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:37,015 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,015 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:37,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:37,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,015 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:37,016 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:37,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:37,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:37,016 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,019 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:37,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,023 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:37,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:37,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:37,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:37,023 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:37,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:37,024 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,024 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:37,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:37,024 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:37,025 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:37,125 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:37,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:37,135 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:37,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:37,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,138 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:37,138 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:37,139 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:37,139 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:37,139 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,139 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,141 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:37,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:37,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,141 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:37,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:37,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,143 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,143 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:37,143 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:37,143 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:37,144 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:37,144 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:37,144 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:37,560 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f89ab0dcb9a14edaa210be251ee02899 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f89ab0dcb9a14edaa210be251ee02899 2023-11-08 22:53:37,968 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/ac5faeb533204fb0a4b8b4587cc3fba0 2023-11-08 22:53:37,977 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/ac5faeb533204fb0a4b8b4587cc3fba0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0 2023-11-08 22:53:37,982 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0, entries=1, sequenceid=25, filesize=4.9 K 2023-11-08 22:53:37,983 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 839ms, sequenceid=25, compaction requested=true 2023-11-08 22:53:37,983 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:37,983 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:37,983 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:37,985 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,985 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:37,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:37,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1239403e[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:37,987 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:37,987 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,988 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:37,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:37,988 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:37,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:37,989 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:37,989 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:37,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:37,993 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:37,993 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:37,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:37,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:37,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,993 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:37,994 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,994 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:37,994 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:37,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:37,995 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,997 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:37,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:37,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:38,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:38,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:38,001 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,001 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:38,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:38,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:38,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:38,001 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:38,001 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:38,102 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:38,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:38,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:38,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:38,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,113 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:38,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:38,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:38,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:38,114 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,114 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,116 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,116 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:38,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:38,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:38,117 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,117 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:38,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,118 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:38,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,119 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:38,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,119 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:38,119 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:38,119 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:38,120 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:38,120 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:38,120 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:38,120 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:38,120 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:38,545 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101b0a3942b340f4e08b2f1c0d9c8ae4c22 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101b0a3942b340f4e08b2f1c0d9c8ae4c22 2023-11-08 22:53:38,954 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/54c30351411741568d45fd2b988064a9 2023-11-08 22:53:38,964 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/54c30351411741568d45fd2b988064a9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9 2023-11-08 22:53:38,970 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9, entries=1, sequenceid=29, filesize=4.9 K 2023-11-08 22:53:38,971 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 851ms, sequenceid=29, compaction requested=true 2023-11-08 22:53:38,971 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:38,971 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:38,971 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:38,971 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:38,971 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,971 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:38,971 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:38,973 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,973 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:38,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:38,973 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,973 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:38,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:38,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:38,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:38,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:38,976 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75259234[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:38,976 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:38,976 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,977 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,977 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:38,977 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:38,977 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:38,977 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,977 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:38,979 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:38,979 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:38,979 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:38,979 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:38,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:38,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:38,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:38,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:38,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:38,982 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:38,982 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:38,982 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:38,982 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,982 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:38,990 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,990 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,990 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:38,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:38,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:38,991 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:38,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,993 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:38,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:38,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:38,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:38,998 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:38,998 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:38,999 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:38,999 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:38,999 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:38,999 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,000 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:39,099 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:39,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:39,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,113 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:39,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:39,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:39,113 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:39,114 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,114 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,116 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,116 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:39,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:39,116 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,116 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:39,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,118 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,118 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:39,118 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,118 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:39,118 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:39,118 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:39,119 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:39,119 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:39,119 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:39,119 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:39,119 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:39,133 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030c79a807670e418b8ce65b1d5b5e3d2d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601030c79a807670e418b8ce65b1d5b5e3d2d 2023-11-08 22:53:39,540 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/f429069b820c410398d04fa3a6ee0419 2023-11-08 22:53:39,553 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/f429069b820c410398d04fa3a6ee0419 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419 2023-11-08 22:53:39,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419, entries=1, sequenceid=33, filesize=4.9 K 2023-11-08 22:53:39,560 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 441ms, sequenceid=33, compaction requested=true 2023-11-08 22:53:39,560 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:39,561 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:39,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:39,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:39,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:39,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:39,564 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:39,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:39,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:39,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2172905f[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:39,567 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:39,567 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,572 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,573 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:39,573 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:39,573 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:39,573 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,573 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:39,575 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:39,575 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:39,575 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,575 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:39,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:39,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:39,580 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:39,580 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:39,580 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:39,580 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:39,580 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,580 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:39,582 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,582 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:39,582 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:39,582 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,584 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:39,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,587 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:39,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:39,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:39,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:39,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:39,588 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:39,588 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,588 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:39,588 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:39,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:39,688 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:39,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:39,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:39,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:39,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,700 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:39,700 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:39,700 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:39,700 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:39,701 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,701 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,702 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:39,702 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:39,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:39,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,706 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:39,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:39,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:39,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:39,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:39,707 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:39,707 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:39,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:39,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:39,707 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:40,135 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090739df213ab19f4623bc7d5905d6fa3614 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090739df213ab19f4623bc7d5905d6fa3614 2023-11-08 22:53:40,542 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/40dafca0125e47e99643abf75c1299a4 2023-11-08 22:53:40,554 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/40dafca0125e47e99643abf75c1299a4 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4 2023-11-08 22:53:40,560 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4, entries=1, sequenceid=37, filesize=4.9 K 2023-11-08 22:53:40,561 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 854ms, sequenceid=37, compaction requested=true 2023-11-08 22:53:40,561 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:40,561 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:40,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:40,562 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:40,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,563 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:40,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:40,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:40,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:40,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f3b5cf9[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:40,567 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:40,567 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,568 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,568 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:40,568 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:40,569 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,569 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:40,570 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:40,570 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,570 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:40,570 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:40,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:40,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:40,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:40,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:40,575 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:40,576 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:40,576 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:40,576 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,576 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:40,581 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,581 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,581 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:40,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:40,583 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:40,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:40,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:40,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:40,599 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:40,598 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,598 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:40,599 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,599 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:40,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:40,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:40,599 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,599 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:40,600 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,700 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:40,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:40,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:40,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:40,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,707 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:40,707 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:40,707 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-08 22:53:40,707 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-08 22:53:40,708 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,708 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,709 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,709 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:40,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:40,709 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:40,709 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:40,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:40,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,710 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,710 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-08 22:53:40,710 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:40,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-08 22:53:40,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:40,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-08 22:53:40,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:40,711 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:40,711 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:40,711 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. started... 2023-11-08 22:53:40,711 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing c6cb330d61b75b359b9996b134426452 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:41,129 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205a9e63592b124ee2b4ed670f9decaad4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511205a9e63592b124ee2b4ed670f9decaad4 2023-11-08 22:53:41,538 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/1fab0bafd00f479bb01ec582acf6aabd 2023-11-08 22:53:41,551 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/1fab0bafd00f479bb01ec582acf6aabd as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd 2023-11-08 22:53:41,556 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd, entries=1, sequenceid=41, filesize=4.9 K 2023-11-08 22:53:41,557 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for c6cb330d61b75b359b9996b134426452 in 846ms, sequenceid=41, compaction requested=true 2023-11-08 22:53:41,557 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:41,557 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:41,557 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:41,557 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-08 22:53:41,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-08 22:53:41,559 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:41,560 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,560 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:41,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:41,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-08 22:53:41,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@275bdb90[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:41,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-08 22:53:41,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-08 22:53:41,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-08 22:53:41,564 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:41,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,564 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:41,565 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-08 22:53:41,565 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,565 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:41,565 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-08 22:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:41,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:41,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:41,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:53:41,568 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-08 22:53:41,568 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:41,569 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:41,569 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,569 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:41,570 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,570 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,570 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:41,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:41,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:41,571 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,573 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:41,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:41,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-08 22:53:41,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:41,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:41,577 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:41,578 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:41,578 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:41,577 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,578 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:41,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:41,678 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:41,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:41,685 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-08 22:53:41,689 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:41,690 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:41,691 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484621691 2023-11-08 22:53:41,691 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:41,694 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:41,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-08 22:53:41,695 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:41,696 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x0c28410f to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:41,700 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@101a032c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:41,700 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,539 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010373270279d05b43c8858cf5935794d2ea to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010373270279d05b43c8858cf5935794d2ea 2023-11-08 22:53:42,540 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:42,552 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:42,553 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39560, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:42,560 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:42,561 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46702, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:42,570 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd5758388573467f8458ed63e0b8528d first=Optional[r3] last=Optional[r6] 2023-11-08 22:53:42,571 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd5758388573467f8458ed63e0b8528d}] 2023-11-08 22:53:42,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd5758388573467f8458ed63e0b8528d for inclusion in c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:42,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-08 22:53:42,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:42,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/bd5758388573467f8458ed63e0b8528d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__919ivkejnf1ke7cr6i1r5tmgeprel7n823trdft20rvl1kisohf9cmsl78rq60fu/family1/bd5758388573467f8458ed63e0b8528d 2023-11-08 22:53:42,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__919ivkejnf1ke7cr6i1r5tmgeprel7n823trdft20rvl1kisohf9cmsl78rq60fu/family1/bd5758388573467f8458ed63e0b8528d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_ 2023-11-08 22:53:42,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__919ivkejnf1ke7cr6i1r5tmgeprel7n823trdft20rvl1kisohf9cmsl78rq60fu/family1/bd5758388573467f8458ed63e0b8528d into c6cb330d61b75b359b9996b134426452/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_ - updating store file list. 2023-11-08 22:53:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_ into c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__919ivkejnf1ke7cr6i1r5tmgeprel7n823trdft20rvl1kisohf9cmsl78rq60fu/family1/bd5758388573467f8458ed63e0b8528d into c6cb330d61b75b359b9996b134426452/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_) 2023-11-08 22:53:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__919ivkejnf1ke7cr6i1r5tmgeprel7n823trdft20rvl1kisohf9cmsl78rq60fu/family1/bd5758388573467f8458ed63e0b8528d 2023-11-08 22:53:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:53:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:53:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): c6cb330d61b75b359b9996b134426452/family1 is initiating minor compaction 2023-11-08 22:53:42,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3e2ef526; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:42,590 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of c6cb330d61b75b359b9996b134426452/family1 in testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:53:42,590 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp, totalSize=50.0 K 2023-11-08 22:53:42,590 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 1524afc44bb74479b554067a633491bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting e5c4586501f5470f8a6204e090ade50d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting bb125f3470d141669d277692b0f8304e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 155b0124cfc147aa8eec0ce1134fb865, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting ac5faeb533204fb0a4b8b4587cc3fba0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 54c30351411741568d45fd2b988064a9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting f429069b820c410398d04fa3a6ee0419, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 40dafca0125e47e99643abf75c1299a4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 1fab0bafd00f479bb01ec582acf6aabd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:53:42,591 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting b539e5ea15114311b4caac703a64092e_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:53:42,592 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:42,593 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:42,594 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f1847164e2d140feb137f96186afdf07 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228f1847164e2d140feb137f96186afdf07 2023-11-08 22:53:42,595 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f89ab0dcb9a14edaa210be251ee02899 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151231f89ab0dcb9a14edaa210be251ee02899 2023-11-08 22:53:42,596 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101b0a3942b340f4e08b2f1c0d9c8ae4c22 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101b0a3942b340f4e08b2f1c0d9c8ae4c22 2023-11-08 22:53:42,597 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601030c79a807670e418b8ce65b1d5b5e3d2d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601030c79a807670e418b8ce65b1d5b5e3d2d 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-08 22:53:42,598 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,598 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,632 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): c6cb330d61b75b359b9996b134426452#family1#compaction#48 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:42,673 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120578a2cbe943f5446a804db446c614b44f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015120578a2cbe943f5446a804db446c614b44f 2023-11-08 22:53:42,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:42,702 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c3816114974b412a985784c660416324 first=Optional[r00] last=Optional[r2] 2023-11-08 22:53:42,703 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c3816114974b412a985784c660416324}] 2023-11-08 22:53:42,709 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c3816114974b412a985784c660416324 for inclusion in c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:42,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-08 22:53:42,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:42,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:42,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/c3816114974b412a985784c660416324 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdveus60dp2roa55lliv93b54j4sd43fcmc55dkhgfv2rv59aluu8kmoh8pg2e4r/family1/c3816114974b412a985784c660416324 2023-11-08 22:53:42,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdveus60dp2roa55lliv93b54j4sd43fcmc55dkhgfv2rv59aluu8kmoh8pg2e4r/family1/c3816114974b412a985784c660416324 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1288cbbefdcb4e429e472ffdc56f0e1d_SeqId_46_ 2023-11-08 22:53:42,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdveus60dp2roa55lliv93b54j4sd43fcmc55dkhgfv2rv59aluu8kmoh8pg2e4r/family1/c3816114974b412a985784c660416324 into c6cb330d61b75b359b9996b134426452/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1288cbbefdcb4e429e472ffdc56f0e1d_SeqId_46_ - updating store file list. 2023-11-08 22:53:42,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1288cbbefdcb4e429e472ffdc56f0e1d_SeqId_46_ into c6cb330d61b75b359b9996b134426452/family1 2023-11-08 22:53:42,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdveus60dp2roa55lliv93b54j4sd43fcmc55dkhgfv2rv59aluu8kmoh8pg2e4r/family1/c3816114974b412a985784c660416324 into c6cb330d61b75b359b9996b134426452/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1288cbbefdcb4e429e472ffdc56f0e1d_SeqId_46_) 2023-11-08 22:53:42,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kdveus60dp2roa55lliv93b54j4sd43fcmc55dkhgfv2rv59aluu8kmoh8pg2e4r/family1/c3816114974b412a985784c660416324 2023-11-08 22:53:42,723 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:42,724 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:42,725 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130ff06c17097d24dfe80c8b0c408e030f3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130ff06c17097d24dfe80c8b0c408e030f3 2023-11-08 22:53:42,726 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201176803951554402fb39c288108a9c46f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201176803951554402fb39c288108a9c46f 2023-11-08 22:53:42,727 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054cc146b28ca145a28ce708d5d0c832f3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512054cc146b28ca145a28ce708d5d0c832f3 2023-11-08 22:53:42,727 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-08 22:53:42,727 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-08 22:53:42,727 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-08 22:53:42,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-08 22:53:42,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:42,728 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:53:42,730 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.0410 sec 2023-11-08 22:53:42,839 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259 (was 260), OpenFileDescriptor=650 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 241), ProcessCount=167 (was 167), AvailableMemoryMB=6334 (was 6415) 2023-11-08 22:53:42,849 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=259, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=6334 2023-11-08 22:53:42,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:53:42,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:42,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:42,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-08 22:53:42,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:42,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:42,857 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:42,858 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b empty. 2023-11-08 22:53:42,858 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:42,858 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-08 22:53:42,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:43,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:43,267 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:43,268 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5995a55ed4bc8f2b5581a5373647758b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:53:43,450 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/.tmp/family1/48b55316cc2f4aa884aa052c67507fcf as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/48b55316cc2f4aa884aa052c67507fcf 2023-11-08 22:53:43,455 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in c6cb330d61b75b359b9996b134426452/family1 of c6cb330d61b75b359b9996b134426452 into 48b55316cc2f4aa884aa052c67507fcf(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:43,455 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:53:43,455 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1699484022590; duration=0sec 2023-11-08 22:53:43,455 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:43,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:43,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_] to archive 2023-11-08 22:53:43,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:43,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1524afc44bb74479b554067a633491bf 2023-11-08 22:53:43,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/e5c4586501f5470f8a6204e090ade50d 2023-11-08 22:53:43,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/bb125f3470d141669d277692b0f8304e 2023-11-08 22:53:43,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/155b0124cfc147aa8eec0ce1134fb865 2023-11-08 22:53:43,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/ac5faeb533204fb0a4b8b4587cc3fba0 2023-11-08 22:53:43,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/54c30351411741568d45fd2b988064a9 2023-11-08 22:53:43,509 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/f429069b820c410398d04fa3a6ee0419 2023-11-08 22:53:43,510 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/40dafca0125e47e99643abf75c1299a4 2023-11-08 22:53:43,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/1fab0bafd00f479bb01ec582acf6aabd 2023-11-08 22:53:43,512 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/family1/b539e5ea15114311b4caac703a64092e_SeqId_44_ 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing 5995a55ed4bc8f2b5581a5373647758b, disabling compactions & flushes 2023-11-08 22:53:43,676 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. after waiting 0 ms 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:43,676 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:43,676 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:43,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:53:43,679 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484023679"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484023679"}]},"ts":"1699484023679"} 2023-11-08 22:53:43,681 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:53:43,681 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:53:43,681 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484023681"}]},"ts":"1699484023681"} 2023-11-08 22:53:43,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-08 22:53:43,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, ASSIGN}] 2023-11-08 22:53:43,686 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, ASSIGN 2023-11-08 22:53:43,686 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:53:43,837 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:43,838 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484023837"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484023837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484023837"}]},"ts":"1699484023837"} 2023-11-08 22:53:43,839 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:43,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:43,991 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:43,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:43,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5995a55ed4bc8f2b5581a5373647758b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:43,996 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:43,999 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:43,999 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:43,999 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5995a55ed4bc8f2b5581a5373647758b columnFamilyName family1 2023-11-08 22:53:44,001 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(310): Store=5995a55ed4bc8f2b5581a5373647758b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:44,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:44,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:44,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:44,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:53:44,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5995a55ed4bc8f2b5581a5373647758b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67995766, jitterRate=0.013215869665145874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:44,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:44,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., pid=41, masterSystemTime=1699484023991 2023-11-08 22:53:44,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:44,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:44,011 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:44,011 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484024011"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484024011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484024011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484024011"}]},"ts":"1699484024011"} 2023-11-08 22:53:44,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-11-08 22:53:44,014 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 174 msec 2023-11-08 22:53:44,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-11-08 22:53:44,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, ASSIGN in 330 msec 2023-11-08 22:53:44,017 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:53:44,017 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484024017"}]},"ts":"1699484024017"} 2023-11-08 22:53:44,018 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-08 22:53:44,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:53:44,022 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1690 sec 2023-11-08 22:53:44,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-08 22:53:44,962 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-08 22:53:44,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:44,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,988 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:44,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:44,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:44,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:44,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,988 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,989 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:44,989 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:44,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:44,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:44,989 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:44,989 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,990 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:44,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:44,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:44,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:44,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:44,991 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:44,991 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:44,991 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:44,991 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:53:45,412 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130abde38d7bc674d528def97dcd87677ad to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130abde38d7bc674d528def97dcd87677ad 2023-11-08 22:53:45,816 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/a4cfbb56c3bd408a8e4563dc97d3274d 2023-11-08 22:53:45,820 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/a4cfbb56c3bd408a8e4563dc97d3274d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d 2023-11-08 22:53:45,825 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-08 22:53:45,826 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 834ms, sequenceid=5, compaction requested=false 2023-11-08 22:53:45,826 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:45,826 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:45,826 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:45,826 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:45,826 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:45,826 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,826 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:45,826 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:45,827 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,827 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:45,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:45,828 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,828 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:45,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:45,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7eb6597d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:45,829 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:45,829 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,830 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,830 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:45,830 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:45,830 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:45,830 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,830 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:45,831 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,831 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:45,831 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:45,831 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:45,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:45,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:45,833 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:45,833 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:45,833 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:45,833 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:45,833 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,833 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:45,835 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,835 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,835 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,835 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:45,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:45,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,836 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:45,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:45,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:45,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:45,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:45,838 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:45,838 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,839 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,839 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,839 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,839 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:45,839 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:45,839 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:45,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:45,939 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:45,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:45,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:45,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:45,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,945 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:45,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:45,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:45,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:45,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,946 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,946 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:45,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:45,946 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:45,946 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:45,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,947 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,947 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,947 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:45,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:45,947 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:45,947 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:45,947 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:45,947 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:45,947 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:45,947 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:45,947 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:45,948 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:53:46,360 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511280b1cca09e85844758939452bd7363754 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280b1cca09e85844758939452bd7363754 2023-11-08 22:53:46,765 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/72ee0ee03266468dbf361c8585da5e43 2023-11-08 22:53:46,770 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/72ee0ee03266468dbf361c8585da5e43 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43 2023-11-08 22:53:46,774 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:53:46,775 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 827ms, sequenceid=9, compaction requested=false 2023-11-08 22:53:46,775 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:46,775 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:46,775 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:46,775 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:46,775 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,775 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:46,775 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:46,777 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,777 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:46,777 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,777 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:46,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:46,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:46,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:46,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b73ce9c[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:46,778 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:46,778 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,779 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,779 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:46,779 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:46,779 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:46,779 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,779 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:46,780 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:46,780 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,780 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:46,780 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:46,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:46,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:46,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:46,782 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:46,782 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:46,782 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:46,782 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,782 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:46,783 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,783 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:46,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,783 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:46,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:46,784 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,785 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:46,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:46,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:46,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:46,787 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,787 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:46,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:46,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:46,888 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:46,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:46,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:46,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:46,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,894 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:46,894 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:46,894 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:46,894 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:46,894 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,894 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,895 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,895 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:46,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:46,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:46,895 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:46,895 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,896 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:46,896 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:46,896 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:46,896 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:46,897 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:46,897 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:46,897 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:46,897 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:46,897 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:46,897 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:47,310 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512016e24acfb218248a893b9d6a6f6807835 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512016e24acfb218248a893b9d6a6f6807835 2023-11-08 22:53:47,716 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/2c786d480f1141adba47275dc5dd3f1c 2023-11-08 22:53:47,721 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/2c786d480f1141adba47275dc5dd3f1c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c 2023-11-08 22:53:47,725 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c, entries=1, sequenceid=13, filesize=5.0 K 2023-11-08 22:53:47,726 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 829ms, sequenceid=13, compaction requested=true 2023-11-08 22:53:47,726 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:47,726 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:47,726 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:47,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:47,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:47,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:47,728 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,728 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:47,728 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,728 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:47,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:47,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:47,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e0a8f9f[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:47,730 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:47,730 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,730 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:47,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:47,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:47,731 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,731 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:47,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:47,732 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:47,732 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:47,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:47,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:47,734 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:47,734 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:47,734 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:47,734 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,734 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:47,735 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,735 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:47,735 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:47,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:47,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:47,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:47,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:47,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:47,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:47,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,738 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:47,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:47,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:47,839 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:47,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:47,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:47,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:47,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,845 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:47,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:47,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:47,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:47,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,846 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:47,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:47,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:47,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:47,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:47,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:47,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,847 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,848 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:47,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:47,848 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:47,848 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:47,848 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:47,848 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:47,848 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:47,848 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:47,848 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:47,848 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:48,260 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205586f7b03378343bb9a0117a723a5bd8b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205586f7b03378343bb9a0117a723a5bd8b 2023-11-08 22:53:48,667 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/8e7d3dc906fd47b98e85a95f611e8e7f 2023-11-08 22:53:48,673 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/8e7d3dc906fd47b98e85a95f611e8e7f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f 2023-11-08 22:53:48,678 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f, entries=1, sequenceid=17, filesize=5.0 K 2023-11-08 22:53:48,678 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 830ms, sequenceid=17, compaction requested=true 2023-11-08 22:53:48,679 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:48,679 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:48,679 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:48,680 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,680 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:48,681 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,681 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:48,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:48,682 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:48,682 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17744e95[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:48,682 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,683 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,683 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:48,683 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:48,683 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:48,683 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,683 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:48,684 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:48,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:48,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:48,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:48,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:48,686 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:48,686 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:48,686 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:48,686 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:48,686 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,686 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:48,687 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,687 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:48,687 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:48,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:48,688 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,689 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,691 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:48,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:48,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:48,691 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:48,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:48,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:48,792 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:48,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:48,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:48,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:48,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,803 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:48,803 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:48,803 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:48,803 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:48,804 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,804 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,807 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:48,807 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:48,808 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:48,808 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:48,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,809 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:48,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,809 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,810 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:48,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:48,810 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:48,810 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:48,810 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:48,810 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:48,810 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:48,810 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:48,810 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:48,811 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:49,226 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122833f4fac889944f08ba0df3f26d3df7a6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122833f4fac889944f08ba0df3f26d3df7a6 2023-11-08 22:53:49,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:53:49,632 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/0399919cc42d4444af578251785f9491 2023-11-08 22:53:49,638 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/0399919cc42d4444af578251785f9491 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491 2023-11-08 22:53:49,644 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491, entries=1, sequenceid=21, filesize=5.0 K 2023-11-08 22:53:49,645 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 834ms, sequenceid=21, compaction requested=true 2023-11-08 22:53:49,645 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:49,645 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:49,645 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:49,647 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:49,648 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,648 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:49,650 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bc580b7[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:49,650 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:49,650 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,651 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,651 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:49,652 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,652 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:49,653 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:49,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:49,657 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:49,657 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:49,657 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:49,657 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,658 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:49,664 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,664 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:49,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,664 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:49,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:49,665 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:49,667 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:49,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,673 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:49,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:49,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:49,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:49,673 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,674 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,674 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,674 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:49,674 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:49,675 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:49,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-08 22:53:49,775 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:49,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:49,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:49,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:49,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,781 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:49,781 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:49,781 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:49,781 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:49,782 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,782 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,783 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,783 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:49,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:49,783 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:49,783 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:49,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:49,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,784 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,784 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:49,784 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:49,784 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:49,785 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:49,785 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:49,785 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:49,785 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:49,785 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:49,785 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:49,785 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:50,198 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b2a20ba5eb0a401ab941d780fcc95e31 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2a20ba5eb0a401ab941d780fcc95e31 2023-11-08 22:53:50,606 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/a23794a9465a4ebdb5baa65d4fe8d421 2023-11-08 22:53:50,618 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/a23794a9465a4ebdb5baa65d4fe8d421 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421 2023-11-08 22:53:50,627 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421, entries=1, sequenceid=25, filesize=5.0 K 2023-11-08 22:53:50,627 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 842ms, sequenceid=25, compaction requested=true 2023-11-08 22:53:50,628 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:50,628 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:50,628 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:50,628 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:50,628 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,628 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:50,628 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:50,629 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,629 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:50,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:50,630 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,630 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:50,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e17b27d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:50,631 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:50,631 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,632 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:50,632 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:50,632 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,632 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:50,633 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,633 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:50,633 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:50,633 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:50,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:50,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:50,635 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:50,635 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:50,635 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:50,635 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,635 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:50,636 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:50,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:50,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:50,637 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,638 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,639 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,639 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:50,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:50,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:50,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:50,640 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:50,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:50,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:50,640 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:50,740 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:50,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:50,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:50,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,751 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:50,752 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:50,752 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:50,752 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:50,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,754 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,754 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:50,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:50,755 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:50,755 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,758 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:50,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:50,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:50,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:50,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:50,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:50,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:50,759 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:50,759 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:50,759 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:51,182 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010143d6d47f279c49b88c74f0337ec3d4d0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010143d6d47f279c49b88c74f0337ec3d4d0 2023-11-08 22:53:51,590 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/0f24afd9ed0342de975e5376fb6f14a6 2023-11-08 22:53:51,603 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/0f24afd9ed0342de975e5376fb6f14a6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6 2023-11-08 22:53:51,610 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6, entries=1, sequenceid=29, filesize=5.0 K 2023-11-08 22:53:51,611 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 852ms, sequenceid=29, compaction requested=true 2023-11-08 22:53:51,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:51,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:51,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:51,613 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:51,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:51,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:51,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34dbb257[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:51,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:51,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,617 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:51,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:51,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:51,617 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,618 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:51,618 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,618 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:51,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:51,618 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:51,618 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:51,621 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:51,621 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:51,621 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:51,621 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,621 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:51,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:51,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:51,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:51,622 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,623 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:51,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:51,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:51,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:51,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:51,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:51,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:51,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:51,625 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:51,726 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:51,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:51,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:51,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:51,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,741 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:51,741 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:51,741 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:51,741 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:51,742 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,742 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,744 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:51,744 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:51,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:51,745 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:51,745 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:51,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,746 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:51,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:51,747 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:51,747 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:51,747 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:51,747 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:51,747 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:51,747 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:51,747 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:51,748 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:52,170 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103813c81f1fc5d4a12b60026ef55603faa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103813c81f1fc5d4a12b60026ef55603faa 2023-11-08 22:53:52,579 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/81aa2e5b72364e81b10fc0a08f8c1872 2023-11-08 22:53:52,589 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/81aa2e5b72364e81b10fc0a08f8c1872 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872 2023-11-08 22:53:52,599 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872, entries=1, sequenceid=33, filesize=5.0 K 2023-11-08 22:53:52,600 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 852ms, sequenceid=33, compaction requested=true 2023-11-08 22:53:52,600 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:52,600 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:52,600 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:52,600 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:52,600 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,600 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:52,600 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:52,602 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,602 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:52,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:52,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:52,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:52,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:52,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16e42bf[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:52,605 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:52,605 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:52,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:52,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:52,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:52,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:52,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:52,617 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:52,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:52,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:52,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:52,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:52,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:52,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:52,625 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:52,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:52,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:52,625 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,625 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:52,631 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,631 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,631 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:52,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:52,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:52,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:52,633 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:52,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:52,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,636 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:52,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,640 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:52,640 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:52,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,640 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:52,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:52,641 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:52,641 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:52,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:52,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:52,741 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:52,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:52,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:52,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:52,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,753 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:52,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:52,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:52,754 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:52,754 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,754 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,756 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,756 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:52,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:52,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:52,756 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:52,756 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:52,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,757 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:52,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,758 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,758 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:52,758 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:52,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:52,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:52,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:52,759 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:52,759 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:52,759 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:52,759 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:53,184 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907495b345d0beb4b2697bdafb2c03589bc to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907495b345d0beb4b2697bdafb2c03589bc 2023-11-08 22:53:53,594 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/083d3dc051ac4bebaaf11dc102549a75 2023-11-08 22:53:53,604 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/083d3dc051ac4bebaaf11dc102549a75 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75 2023-11-08 22:53:53,609 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75, entries=1, sequenceid=37, filesize=5.0 K 2023-11-08 22:53:53,610 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 851ms, sequenceid=37, compaction requested=true 2023-11-08 22:53:53,610 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:53,610 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:53,610 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:53,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:53,612 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:53,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:53,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:53,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:53,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:53,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7659ba1d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:53,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:53,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,615 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,616 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:53,616 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:53,616 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:53,616 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,616 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:53,616 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:53,616 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:53,617 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:53,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:53,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:53,620 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:53,620 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:53,620 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:53,620 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,620 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:53,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:53,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:53,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:53,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:53,623 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:53,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,624 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:53,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:53,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:53,626 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:53,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:53,626 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:53,627 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:53,626 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:53,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:53,627 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,627 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,627 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,727 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:53,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:53,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:53:53,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-08 22:53:53,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,737 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:53,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:53,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-08 22:53:53,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-08 22:53:53,739 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,739 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:53,740 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:53,741 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:53,741 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:53:53,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:53:53,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,743 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,743 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-08 22:53:53,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:53,743 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-08 22:53:53,743 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:53:53,743 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-08 22:53:53,744 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:53:53,744 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:53:53,744 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:53,744 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. started... 2023-11-08 22:53:53,744 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5995a55ed4bc8f2b5581a5373647758b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:53:54,156 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120f0ad8ce5a2894e6ca1c10436c7313082 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f0ad8ce5a2894e6ca1c10436c7313082 2023-11-08 22:53:54,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/8de2dadc5cdb43d8adde30c813c2674c 2023-11-08 22:53:54,576 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/8de2dadc5cdb43d8adde30c813c2674c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c 2023-11-08 22:53:54,582 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c, entries=1, sequenceid=41, filesize=5.0 K 2023-11-08 22:53:54,583 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 5995a55ed4bc8f2b5581a5373647758b in 839ms, sequenceid=41, compaction requested=true 2023-11-08 22:53:54,583 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:54,584 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:54,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:53:54,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:53:54,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-08 22:53:54,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-08 22:53:54,586 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,586 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:54,586 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:54,586 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:54,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-08 22:53:54,588 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@456e7af1[Count = 0] remaining members to acquire global barrier 2023-11-08 22:53:54,588 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-08 22:53:54,588 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,589 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,589 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-08 22:53:54,589 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-08 22:53:54,589 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:53:54,589 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,590 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:53:54,591 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-08 22:53:54,591 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,591 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:54,591 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-08 22:53:54,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:54,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:53:54,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-08 22:53:54,595 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-08 22:53:54,595 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:53:54,595 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:53:54,595 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,595 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:53:54,606 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,606 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:53:54,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:53:54,606 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:54,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:54,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:53:54,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:53:54,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,610 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:53:54,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:53:54,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:53:54,615 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:53:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-08 22:53:54,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:53:54,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:53:54,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:53:54,615 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:54,615 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-08 22:53:54,615 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,615 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:53:54,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:53:54,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:53:54,616 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,616 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,716 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:53:54,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:53:54,721 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:54,725 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:54,726 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:54,727 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:54,727 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484634727 2023-11-08 22:53:54,731 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:54,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-08 22:53:54,732 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:54,734 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x7b48a75c to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:54,739 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e50c4e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:54,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,589 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010373a41272608846d9a82285fe33abef3c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010373a41272608846d9a82285fe33abef3c 2023-11-08 22:53:55,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:55,601 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:55,602 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:55,610 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:55,612 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:55,628 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 first=Optional[r3] last=Optional[r6] 2023-11-08 22:53:55,629 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8}] 2023-11-08 22:53:55,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 for inclusion in 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:55,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-08 22:53:55,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:55,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:55,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n1b064bgm7k4i6jenp5290j9mnd74d0cv09diuhj2p0dema8n84ruls9ma0oo4vm/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 2023-11-08 22:53:55,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n1b064bgm7k4i6jenp5290j9mnd74d0cv09diuhj2p0dema8n84ruls9ma0oo4vm/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_ 2023-11-08 22:53:55,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n1b064bgm7k4i6jenp5290j9mnd74d0cv09diuhj2p0dema8n84ruls9ma0oo4vm/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 into 5995a55ed4bc8f2b5581a5373647758b/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_ - updating store file list. 2023-11-08 22:53:55,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_ into 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:55,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n1b064bgm7k4i6jenp5290j9mnd74d0cv09diuhj2p0dema8n84ruls9ma0oo4vm/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 into 5995a55ed4bc8f2b5581a5373647758b/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_) 2023-11-08 22:53:55,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__n1b064bgm7k4i6jenp5290j9mnd74d0cv09diuhj2p0dema8n84ruls9ma0oo4vm/family1/39d4e4d4f26c43bf98fcd6e5fb777ea8 2023-11-08 22:53:55,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:53:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:53:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 5995a55ed4bc8f2b5581a5373647758b/family1 is initiating minor compaction 2023-11-08 22:53:55,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@31b7dca4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:55,651 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5995a55ed4bc8f2b5581a5373647758b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:55,651 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp, totalSize=50.4 K 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 72ee0ee03266468dbf361c8585da5e43, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 2c786d480f1141adba47275dc5dd3f1c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 8e7d3dc906fd47b98e85a95f611e8e7f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0399919cc42d4444af578251785f9491, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a23794a9465a4ebdb5baa65d4fe8d421, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0f24afd9ed0342de975e5376fb6f14a6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:53:55,651 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 81aa2e5b72364e81b10fc0a08f8c1872, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:53:55,652 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 083d3dc051ac4bebaaf11dc102549a75, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:53:55,652 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 8de2dadc5cdb43d8adde30c813c2674c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:53:55,652 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:53:55,655 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:55,666 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:55,668 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122833f4fac889944f08ba0df3f26d3df7a6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122833f4fac889944f08ba0df3f26d3df7a6 2023-11-08 22:53:55,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2a20ba5eb0a401ab941d780fcc95e31 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231b2a20ba5eb0a401ab941d780fcc95e31 2023-11-08 22:53:55,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010143d6d47f279c49b88c74f0337ec3d4d0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010143d6d47f279c49b88c74f0337ec3d4d0 2023-11-08 22:53:55,673 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103813c81f1fc5d4a12b60026ef55603faa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103813c81f1fc5d4a12b60026ef55603faa 2023-11-08 22:53:55,673 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-08 22:53:55,673 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,674 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:55,683 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5995a55ed4bc8f2b5581a5373647758b#family1#compaction#59 average throughput is 0.40 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:55,726 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/0f42e2b631d94ff88cc2733dc0101062 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f42e2b631d94ff88cc2733dc0101062 2023-11-08 22:53:55,739 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 5995a55ed4bc8f2b5581a5373647758b/family1 of 5995a55ed4bc8f2b5581a5373647758b into 0f42e2b631d94ff88cc2733dc0101062(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:53:55,739 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:55,739 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699484035651; duration=0sec 2023-11-08 22:53:55,739 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:55,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_] to archive 2023-11-08 22:53:55,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:55,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/72ee0ee03266468dbf361c8585da5e43 2023-11-08 22:53:55,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2c786d480f1141adba47275dc5dd3f1c 2023-11-08 22:53:55,812 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8e7d3dc906fd47b98e85a95f611e8e7f 2023-11-08 22:53:55,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0399919cc42d4444af578251785f9491 2023-11-08 22:53:55,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a23794a9465a4ebdb5baa65d4fe8d421 2023-11-08 22:53:55,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f24afd9ed0342de975e5376fb6f14a6 2023-11-08 22:53:55,818 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/81aa2e5b72364e81b10fc0a08f8c1872 2023-11-08 22:53:55,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/083d3dc051ac4bebaaf11dc102549a75 2023-11-08 22:53:55,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/8de2dadc5cdb43d8adde30c813c2674c 2023-11-08 22:53:55,822 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9de604c2402c4b8cbd7b7910647e2b86_SeqId_44_ 2023-11-08 22:53:56,148 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120524eb07c1a12b4ce1b0e59929121c194c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015120524eb07c1a12b4ce1b0e59929121c194c 2023-11-08 22:53:56,149 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:56,172 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52090dfc6a02432d925c601d9ae40100 first=Optional[r00] last=Optional[r2] 2023-11-08 22:53:56,173 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52090dfc6a02432d925c601d9ae40100}] 2023-11-08 22:53:56,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52090dfc6a02432d925c601d9ae40100 for inclusion in 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:56,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-08 22:53:56,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:56,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:56,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/52090dfc6a02432d925c601d9ae40100 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i7b19c5un2e4fo9oc9ebdefskkd1e6gpvohihp6b1v21hjlg7fd54ksaas6ksl1/family1/52090dfc6a02432d925c601d9ae40100 2023-11-08 22:53:56,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i7b19c5un2e4fo9oc9ebdefskkd1e6gpvohihp6b1v21hjlg7fd54ksaas6ksl1/family1/52090dfc6a02432d925c601d9ae40100 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_ 2023-11-08 22:53:56,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i7b19c5un2e4fo9oc9ebdefskkd1e6gpvohihp6b1v21hjlg7fd54ksaas6ksl1/family1/52090dfc6a02432d925c601d9ae40100 into 5995a55ed4bc8f2b5581a5373647758b/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_ - updating store file list. 2023-11-08 22:53:56,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_ into 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:56,188 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i7b19c5un2e4fo9oc9ebdefskkd1e6gpvohihp6b1v21hjlg7fd54ksaas6ksl1/family1/52090dfc6a02432d925c601d9ae40100 into 5995a55ed4bc8f2b5581a5373647758b/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_) 2023-11-08 22:53:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__i7b19c5un2e4fo9oc9ebdefskkd1e6gpvohihp6b1v21hjlg7fd54ksaas6ksl1/family1/52090dfc6a02432d925c601d9ae40100 2023-11-08 22:53:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:53:56,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:53:56,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 5995a55ed4bc8f2b5581a5373647758b/family1 is initiating minor compaction (all files) 2023-11-08 22:53:56,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@25674a7e; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:56,190 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 5995a55ed4bc8f2b5581a5373647758b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:56,190 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f42e2b631d94ff88cc2733dc0101062, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp, totalSize=390.1 K 2023-11-08 22:53:56,191 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a4cfbb56c3bd408a8e4563dc97d3274d, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850434 2023-11-08 22:53:56,191 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0f42e2b631d94ff88cc2733dc0101062, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250434 2023-11-08 22:53:56,192 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 9d938435e8964e34812d664d36f3c32f_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850434 2023-11-08 22:53:56,192 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:56,192 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:56,194 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130abde38d7bc674d528def97dcd87677ad to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130abde38d7bc674d528def97dcd87677ad 2023-11-08 22:53:56,195 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512016e24acfb218248a893b9d6a6f6807835 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512016e24acfb218248a893b9d6a6f6807835 2023-11-08 22:53:56,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205586f7b03378343bb9a0117a723a5bd8b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205586f7b03378343bb9a0117a723a5bd8b 2023-11-08 22:53:56,197 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-08 22:53:56,197 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-08 22:53:56,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:56,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:56,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:56,199 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:56,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4760 sec 2023-11-08 22:53:56,210 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 5995a55ed4bc8f2b5581a5373647758b#family1#compaction#60 average throughput is 18.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:53:56,288 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-08 22:53:56,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:56,699 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-08 22:53:56,700 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-08 22:53:56,700 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-08 22:53:56,703 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-08 22:53:56,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE}] 2023-11-08 22:53:56,707 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE 2023-11-08 22:53:56,707 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:56,707 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484036707"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484036707"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484036707"}]},"ts":"1699484036707"} 2023-11-08 22:53:56,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:56,860 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:56,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:56,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5995a55ed4bc8f2b5581a5373647758b, disabling compactions & flushes 2023-11-08 22:53:56,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,442 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/.tmp/family1/ec203b9f954444aab4e1b96f2e731835 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/ec203b9f954444aab4e1b96f2e731835 2023-11-08 22:53:57,449 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 5995a55ed4bc8f2b5581a5373647758b/family1 of 5995a55ed4bc8f2b5581a5373647758b into ec203b9f954444aab4e1b96f2e731835(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:53:57,449 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:57,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,449 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1699484036190; duration=1sec 2023-11-08 22:53:57,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. after waiting 0 ms 2023-11-08 22:53:57,449 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:53:57,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,451 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f42e2b631d94ff88cc2733dc0101062, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_] to archive 2023-11-08 22:53:57,453 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:57,455 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/a4cfbb56c3bd408a8e4563dc97d3274d 2023-11-08 22:53:57,457 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f42e2b631d94ff88cc2733dc0101062 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/0f42e2b631d94ff88cc2733dc0101062 2023-11-08 22:53:57,458 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/9d938435e8964e34812d664d36f3c32f_SeqId_47_ 2023-11-08 22:53:57,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-08 22:53:57,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:57,467 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 5995a55ed4bc8f2b5581a5373647758b to self. 2023-11-08 22:53:57,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,469 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=CLOSED 2023-11-08 22:53:57,469 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484037469"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484037469"}]},"ts":"1699484037469"} 2023-11-08 22:53:57,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-11-08 22:53:57,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 763 msec 2023-11-08 22:53:57,474 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=true 2023-11-08 22:53:57,624 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:57,624 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484037624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484037624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484037624"}]},"ts":"1699484037624"} 2023-11-08 22:53:57,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:57,778 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:57,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5995a55ed4bc8f2b5581a5373647758b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,782 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,783 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:57,783 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:57,784 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5995a55ed4bc8f2b5581a5373647758b columnFamilyName family1 2023-11-08 22:53:57,788 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/ec203b9f954444aab4e1b96f2e731835 2023-11-08 22:53:57,788 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(310): Store=5995a55ed4bc8f2b5581a5373647758b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:57,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:57,794 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5995a55ed4bc8f2b5581a5373647758b; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68901548, jitterRate=0.026713073253631592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:57,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:57,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., pid=47, masterSystemTime=1699484037778 2023-11-08 22:53:57,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:57,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:57,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484037798"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484037798"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484037798"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484037798"}]},"ts":"1699484037798"} 2023-11-08 22:53:57,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-11-08 22:53:57,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 173 msec 2023-11-08 22:53:57,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-11-08 22:53:57,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE in 1.0950 sec 2023-11-08 22:53:57,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-11-08 22:53:57,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1000 sec 2023-11-08 22:53:57,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5160 sec 2023-11-08 22:53:57,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-08 22:53:57,807 INFO [Listener at localhost/37975] compactions.TestMobCompactor(278): alter status finished 2023-11-08 22:53:57,808 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:57,810 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:57,810 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:57,811 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:57,811 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484637811 2023-11-08 22:53:57,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:57,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-08 22:53:57,813 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:57,814 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x6ef075d5 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:57,825 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6efeb0b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:57,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:57,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:57,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:57,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:57,825 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:58,658 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288712a653e27749c2b48172b03106a806 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511288712a653e27749c2b48172b03106a806 2023-11-08 22:53:58,659 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:58,669 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:53:58,670 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:53:58,678 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:53:58,679 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54172, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:53:58,689 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b65859eff3d64735b566cec40c5b9fc5 first=Optional[r05] last=Optional[r8] 2023-11-08 22:53:58,689 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b65859eff3d64735b566cec40c5b9fc5}] 2023-11-08 22:53:58,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b65859eff3d64735b566cec40c5b9fc5 for inclusion in 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-08 22:53:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:53:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:58,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b65859eff3d64735b566cec40c5b9fc5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__g53sd6k35ck4dui65sqn92c5vc25t8001nmq0ji4u6h4na6rhlm565p9k0hdt699/family1/b65859eff3d64735b566cec40c5b9fc5 2023-11-08 22:53:58,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__g53sd6k35ck4dui65sqn92c5vc25t8001nmq0ji4u6h4na6rhlm565p9k0hdt699/family1/b65859eff3d64735b566cec40c5b9fc5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2e333ad366ad486196675bbcc58bbe9b_SeqId_53_ 2023-11-08 22:53:58,702 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__g53sd6k35ck4dui65sqn92c5vc25t8001nmq0ji4u6h4na6rhlm565p9k0hdt699/family1/b65859eff3d64735b566cec40c5b9fc5 into 5995a55ed4bc8f2b5581a5373647758b/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2e333ad366ad486196675bbcc58bbe9b_SeqId_53_ - updating store file list. 2023-11-08 22:53:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2e333ad366ad486196675bbcc58bbe9b_SeqId_53_ into 5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:58,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__g53sd6k35ck4dui65sqn92c5vc25t8001nmq0ji4u6h4na6rhlm565p9k0hdt699/family1/b65859eff3d64735b566cec40c5b9fc5 into 5995a55ed4bc8f2b5581a5373647758b/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2e333ad366ad486196675bbcc58bbe9b_SeqId_53_) 2023-11-08 22:53:58,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__g53sd6k35ck4dui65sqn92c5vc25t8001nmq0ji4u6h4na6rhlm565p9k0hdt699/family1/b65859eff3d64735b566cec40c5b9fc5 2023-11-08 22:53:58,709 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:58,710 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:53:58,711 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f0ad8ce5a2894e6ca1c10436c7313082 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120f0ad8ce5a2894e6ca1c10436c7313082 2023-11-08 22:53:58,712 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280b1cca09e85844758939452bd7363754 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511280b1cca09e85844758939452bd7363754 2023-11-08 22:53:58,712 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-08 22:53:58,712 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-08 22:53:58,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:58,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:58,713 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:58,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:58,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:58,714 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:58,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 905 msec 2023-11-08 22:53:58,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:53:58,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:59,179 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-08 22:53:59,180 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-08 22:53:59,180 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-08 22:53:59,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-08 22:53:59,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE}] 2023-11-08 22:53:59,191 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE 2023-11-08 22:53:59,192 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:59,193 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484039192"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484039192"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484039192"}]},"ts":"1699484039192"} 2023-11-08 22:53:59,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:59,347 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:59,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5995a55ed4bc8f2b5581a5373647758b, disabling compactions & flushes 2023-11-08 22:53:59,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. after waiting 0 ms 2023-11-08 22:53:59,348 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-08 22:53:59,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:59,357 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 5995a55ed4bc8f2b5581a5373647758b to self. 2023-11-08 22:53:59,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,359 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=CLOSED 2023-11-08 22:53:59,359 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484039359"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484039359"}]},"ts":"1699484039359"} 2023-11-08 22:53:59,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-11-08 22:53:59,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 165 msec 2023-11-08 22:53:59,362 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=true 2023-11-08 22:53:59,512 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:59,512 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484039512"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484039512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484039512"}]},"ts":"1699484039512"} 2023-11-08 22:53:59,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:53:59,665 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:59,668 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5995a55ed4bc8f2b5581a5373647758b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:53:59,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:53:59,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,670 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,671 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:59,671 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1 2023-11-08 22:53:59,672 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5995a55ed4bc8f2b5581a5373647758b columnFamilyName family1 2023-11-08 22:53:59,682 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/2e333ad366ad486196675bbcc58bbe9b_SeqId_53_ 2023-11-08 22:53:59,685 DEBUG [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/family1/ec203b9f954444aab4e1b96f2e731835 2023-11-08 22:53:59,686 INFO [StoreOpener-5995a55ed4bc8f2b5581a5373647758b-1] regionserver.HStore(310): Store=5995a55ed4bc8f2b5581a5373647758b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:53:59,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:53:59,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5995a55ed4bc8f2b5581a5373647758b; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65865649, jitterRate=-0.018525347113609314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:53:59,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:53:59,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b., pid=53, masterSystemTime=1699484039665 2023-11-08 22:53:59,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:53:59,694 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=5995a55ed4bc8f2b5581a5373647758b, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:53:59,694 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1699484039694"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484039694"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484039694"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484039694"}]},"ts":"1699484039694"} 2023-11-08 22:53:59,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-11-08 22:53:59,697 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 5995a55ed4bc8f2b5581a5373647758b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 181 msec 2023-11-08 22:53:59,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-11-08 22:53:59,698 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=5995a55ed4bc8f2b5581a5373647758b, REOPEN/MOVE in 507 msec 2023-11-08 22:53:59,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-11-08 22:53:59,700 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 512 msec 2023-11-08 22:53:59,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 931 msec 2023-11-08 22:53:59,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-08 22:53:59,704 INFO [Listener at localhost/37975] compactions.TestMobCompactor(278): alter status finished 2023-11-08 22:53:59,705 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-08 22:53:59,706 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:59,707 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:59,708 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:59,708 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484639707 2023-11-08 22:53:59,708 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:53:59,709 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-08 22:53:59,709 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:59,711 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x60ce7913 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:53:59,715 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@190071b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:53:59,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,715 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,716 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-08 22:53:59,716 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-08 22:53:59,716 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:53:59,718 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-08 22:53:59,719 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 12 msec 2023-11-08 22:53:59,784 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 259), OpenFileDescriptor=645 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 195) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=6003 (was 6334) 2023-11-08 22:53:59,796 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=645, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=167, AvailableMemoryMB=6002 2023-11-08 22:53:59,798 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-08 22:53:59,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:53:59,801 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:53:59,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-08 22:53:59,802 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:53:59,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:53:59,804 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:53:59,805 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e empty. 2023-11-08 22:53:59,805 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:53:59,805 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-08 22:53:59,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:54:00,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:54:00,213 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:00,214 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ba213ea03a0da8d4bf57368d963be5e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:00,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 1ba213ea03a0da8d4bf57368d963be5e, disabling compactions & flushes 2023-11-08 22:54:00,621 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. after waiting 0 ms 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,621 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,621 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:00,624 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:54:00,625 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484040625"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484040625"}]},"ts":"1699484040625"} 2023-11-08 22:54:00,627 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:54:00,628 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:54:00,628 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484040628"}]},"ts":"1699484040628"} 2023-11-08 22:54:00,630 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-08 22:54:00,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, ASSIGN}] 2023-11-08 22:54:00,636 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, ASSIGN 2023-11-08 22:54:00,637 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:00,788 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:00,788 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484040788"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484040788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484040788"}]},"ts":"1699484040788"} 2023-11-08 22:54:00,790 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:00,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:54:00,941 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:00,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ba213ea03a0da8d4bf57368d963be5e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:54:00,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:00,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,947 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,949 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:00,949 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:00,949 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ba213ea03a0da8d4bf57368d963be5e columnFamilyName family1 2023-11-08 22:54:00,952 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(310): Store=1ba213ea03a0da8d4bf57368d963be5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:00,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:00,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:00,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1ba213ea03a0da8d4bf57368d963be5e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61571259, jitterRate=-0.08251674473285675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:54:00,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:00,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., pid=57, masterSystemTime=1699484040941 2023-11-08 22:54:00,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:00,971 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:00,972 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484040971"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484040971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484040971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484040971"}]},"ts":"1699484040971"} 2023-11-08 22:54:00,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-11-08 22:54:00,976 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133 in 184 msec 2023-11-08 22:54:00,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-11-08 22:54:00,978 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, ASSIGN in 342 msec 2023-11-08 22:54:00,979 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:54:00,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484040979"}]},"ts":"1699484040979"} 2023-11-08 22:54:00,981 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-08 22:54:00,983 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:54:00,985 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1850 sec 2023-11-08 22:54:01,564 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:01,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-08 22:54:01,907 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-08 22:54:01,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:01,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,943 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:01,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:01,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:01,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:01,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,943 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,944 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:01,944 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:01,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:01,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:01,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:01,945 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:01,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,951 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:01,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:01,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:01,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:01,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:01,951 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:01,951 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:01,951 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:01,952 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:54:02,393 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113035d274f37a0747068092da6b5345d45a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113035d274f37a0747068092da6b5345d45a 2023-11-08 22:54:02,799 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/9011736c75564fec92f9f93468ecb998 2023-11-08 22:54:02,809 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/9011736c75564fec92f9f93468ecb998 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998 2023-11-08 22:54:02,815 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-08 22:54:02,815 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 863ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:02,816 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:02,816 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:02,816 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:02,818 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,818 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:02,818 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,818 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:02,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:02,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:02,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:02,819 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c4e3101[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:02,819 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:02,820 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,820 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,820 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:02,820 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:02,820 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:02,821 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,821 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:02,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:02,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:02,823 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:02,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:02,827 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:02,827 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:02,827 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:02,827 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,827 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:02,847 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,847 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,847 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:02,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:02,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:02,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,850 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,850 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:02,850 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:02,850 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:02,850 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,851 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:02,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-08 22:54:02,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:02,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:02,851 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:02,951 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:02,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:02,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:02,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:02,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,958 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:02,958 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:02,958 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:02,958 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:02,959 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,959 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,960 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:02,960 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:02,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:02,960 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:02,960 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:02,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,960 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,961 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,961 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:02,961 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:02,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:02,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:02,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:02,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:02,961 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:02,961 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:02,961 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:02,961 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:54:03,003 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:54:03,376 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511288871012646234cd98b3b418c08d0ec89 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511288871012646234cd98b3b418c08d0ec89 2023-11-08 22:54:03,783 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/ad421cf2d4294ffe899e3aa7344a9dac 2023-11-08 22:54:03,795 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/ad421cf2d4294ffe899e3aa7344a9dac as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac 2023-11-08 22:54:03,801 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:54:03,802 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 841ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:03,802 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:03,802 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:03,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:03,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:03,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:03,802 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:03,804 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,804 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:03,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:03,804 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,804 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:03,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:03,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:03,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f46f58d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:03,806 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:03,806 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,807 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,807 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:03,807 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:03,807 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:03,807 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,808 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:03,808 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:03,808 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,808 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:03,809 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:03,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:03,812 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:03,812 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:03,812 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:03,812 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:03,812 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,812 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:03,813 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,813 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,813 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:03,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:03,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:03,814 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:03,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:03,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,816 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:03,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:03,822 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:03,822 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-08 22:54:03,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:03,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:03,822 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,822 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,823 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,823 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,823 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,823 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:03,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:03,823 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:03,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:03,923 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:03,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:03,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:03,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:03,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,936 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:03,936 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:03,937 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:03,937 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:03,937 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,937 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,938 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:03,939 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:03,939 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:03,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,939 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:03,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:03,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,940 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,941 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:03,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:03,941 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:03,941 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:03,941 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:03,941 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:03,941 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:03,941 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:03,941 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:03,941 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:03,957 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201819346b0b37d44d487d76f21c6626894 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201819346b0b37d44d487d76f21c6626894 2023-11-08 22:54:04,364 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6 2023-11-08 22:54:04,376 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6 2023-11-08 22:54:04,383 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6, entries=1, sequenceid=13, filesize=5.0 K 2023-11-08 22:54:04,384 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 443ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:04,384 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:04,384 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:04,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:04,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:04,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:04,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:04,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,386 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:04,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:04,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:04,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:04,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:04,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:04,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64f4252a[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:04,390 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:04,390 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,391 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:04,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:04,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:04,392 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,392 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:04,393 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:04,393 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,393 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:04,393 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:04,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:04,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:04,398 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:04,398 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:04,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:04,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:04,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,399 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:04,405 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,406 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:04,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,406 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:04,407 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:04,407 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,409 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:04,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,416 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:04,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:04,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,417 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:04,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:04,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:04,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:04,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:04,417 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,418 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:04,418 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,418 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:04,418 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,418 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:04,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:04,518 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:04,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:04,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:04,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:04,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,534 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:04,534 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:04,534 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:04,534 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:04,535 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,535 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,537 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:04,537 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:04,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:04,538 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:04,538 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:04,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:04,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,539 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,539 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:04,539 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:04,539 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:04,539 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:04,539 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:04,540 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:04,540 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:04,540 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:04,540 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:04,540 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:04,965 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052ca7b98886274ca89a2bdc50f1c1153c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ca7b98886274ca89a2bdc50f1c1153c 2023-11-08 22:54:05,373 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/95a143fe6de541a38228bc98b742f512 2023-11-08 22:54:05,379 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/95a143fe6de541a38228bc98b742f512 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512 2023-11-08 22:54:05,387 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512, entries=1, sequenceid=17, filesize=5.0 K 2023-11-08 22:54:05,388 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 848ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:05,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:05,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:05,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:05,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:05,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:05,389 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:05,391 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:05,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:05,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:05,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:05,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:05,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:05,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@527b62b7[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:05,396 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:05,396 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,405 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,406 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:05,406 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:05,406 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:05,406 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,406 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:05,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:05,408 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:05,408 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:05,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:05,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:05,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:05,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:05,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:05,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:05,417 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:05,417 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:05,417 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:05,418 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,418 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:05,422 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,422 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:05,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,422 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:05,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:05,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:05,424 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:05,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,426 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:05,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,430 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,430 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:05,430 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,431 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:05,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:05,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:05,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:05,431 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:05,432 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:05,532 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:05,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:05,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:05,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:05,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,546 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:05,546 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:05,546 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:05,546 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:05,547 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,547 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,549 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:05,549 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:05,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:05,550 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:05,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,550 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:05,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:05,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:05,552 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:05,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:05,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:05,558 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:05,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:05,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:05,979 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286d5a3c39c1824e46a6c64ab3cdf745a8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286d5a3c39c1824e46a6c64ab3cdf745a8 2023-11-08 22:54:06,387 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/db906719438b40ccb223718694d23b5d 2023-11-08 22:54:06,401 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/db906719438b40ccb223718694d23b5d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d 2023-11-08 22:54:06,408 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d, entries=1, sequenceid=21, filesize=5.0 K 2023-11-08 22:54:06,409 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 850ms, sequenceid=21, compaction requested=true 2023-11-08 22:54:06,409 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:06,409 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:06,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:06,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:06,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:06,409 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:06,411 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,411 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:06,412 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,412 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:06,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:06,414 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:06,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fe097c0[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:06,414 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,415 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:06,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:06,415 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:06,415 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,415 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:06,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:06,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:06,416 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,416 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:06,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:06,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:06,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:06,418 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:06,418 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:06,418 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:06,418 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,418 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:06,419 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,419 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:06,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,419 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:06,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:06,420 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,421 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:06,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:06,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:06,423 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:06,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:06,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:06,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:06,423 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:06,524 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:06,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:06,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:06,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:06,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,531 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:06,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:06,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:06,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:06,532 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,532 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,533 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:06,533 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:06,533 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:06,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,533 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:06,534 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:06,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,534 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,535 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:06,535 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:06,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:06,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:06,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:06,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:06,535 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:06,535 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:06,535 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:06,535 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:06,957 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231979e1a8026ff4d659de7369938aad3c5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231979e1a8026ff4d659de7369938aad3c5 2023-11-08 22:54:07,365 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/a799e993bc9c402fa5073cb14bd04368 2023-11-08 22:54:07,377 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/a799e993bc9c402fa5073cb14bd04368 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368 2023-11-08 22:54:07,383 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368, entries=1, sequenceid=25, filesize=5.0 K 2023-11-08 22:54:07,384 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 849ms, sequenceid=25, compaction requested=true 2023-11-08 22:54:07,384 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:07,384 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:07,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:07,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:07,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:07,384 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:07,386 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:07,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:07,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,387 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:07,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:07,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:07,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6762e12c[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:07,389 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:07,389 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,390 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:07,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:07,391 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:07,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:07,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:07,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:07,392 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,392 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:07,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:07,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:07,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:07,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:07,397 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:07,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:07,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:07,398 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,398 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:07,405 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,405 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:07,405 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:07,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:07,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:07,407 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:07,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:07,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,409 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:07,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,414 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:07,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:07,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-08 22:54:07,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:07,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:07,414 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,414 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:07,415 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:07,415 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:07,415 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:07,415 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:07,415 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,515 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:07,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:07,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:07,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:07,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,529 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:07,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:07,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:07,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:07,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,530 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:07,530 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:07,530 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:07,530 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:07,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:07,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,531 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,531 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:07,531 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:07,531 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:07,531 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:07,531 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:07,532 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:07,949 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101abba088927c540999dee3388596ffce1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101abba088927c540999dee3388596ffce1 2023-11-08 22:54:08,358 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/a2b8f91282a54601813007751eace88e 2023-11-08 22:54:08,370 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/a2b8f91282a54601813007751eace88e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e 2023-11-08 22:54:08,377 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e, entries=1, sequenceid=29, filesize=5.0 K 2023-11-08 22:54:08,378 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 846ms, sequenceid=29, compaction requested=true 2023-11-08 22:54:08,378 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:08,378 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,378 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:08,379 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:08,380 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,380 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:08,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:08,381 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,381 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:08,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:08,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@227a459f[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:08,384 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:08,384 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,384 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,385 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:08,385 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:08,385 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:08,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:08,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:08,386 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:08,386 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:08,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:08,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:08,389 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:08,389 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:08,389 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:08,389 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,389 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:08,391 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:08,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:08,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:08,391 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:08,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,393 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:08,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,395 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,395 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,395 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:08,395 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:08,396 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:08,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:08,396 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:08,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:08,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:08,396 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:08,497 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:08,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:08,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:08,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:08,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,503 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:08,503 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:08,503 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:08,503 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:08,503 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,503 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,504 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,504 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:08,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:08,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:08,504 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:08,505 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:08,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,505 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,505 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:08,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:08,506 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:08,506 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:08,506 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:08,507 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:08,507 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:08,507 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:08,507 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:08,507 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:08,925 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c563d220fade4a1f89fc849081e08ca2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c563d220fade4a1f89fc849081e08ca2 2023-11-08 22:54:09,333 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/5f3a72dd4e4749acb95d298c965b5ac5 2023-11-08 22:54:09,346 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/5f3a72dd4e4749acb95d298c965b5ac5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5 2023-11-08 22:54:09,352 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5, entries=1, sequenceid=33, filesize=5.0 K 2023-11-08 22:54:09,353 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 846ms, sequenceid=33, compaction requested=true 2023-11-08 22:54:09,353 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:09,353 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:09,353 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:09,355 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,355 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:09,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:09,355 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,355 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:09,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:09,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b9de5bd[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:09,358 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:09,358 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,359 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,360 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:09,360 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:09,360 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:09,360 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,360 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:09,361 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:09,361 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,361 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:09,361 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:09,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:09,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:09,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:09,363 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:09,363 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:09,363 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:09,363 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,363 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:09,364 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,364 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,365 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:09,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:09,365 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,366 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,368 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:09,368 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:09,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:09,368 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:09,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-08 22:54:09,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:09,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:09,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:09,368 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,368 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,368 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:09,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:09,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,369 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:09,469 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:09,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:09,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:09,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,479 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:09,480 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:09,480 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:09,480 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:09,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,481 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,482 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:09,482 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:09,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:09,482 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:09,482 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,483 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:09,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:09,484 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:09,484 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:09,484 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:09,484 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:09,484 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:09,484 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:09,484 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:09,484 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:09,896 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509074cf8625b3a244fcd87a3df3492bb5c9f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509074cf8625b3a244fcd87a3df3492bb5c9f 2023-11-08 22:54:10,303 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/b919f6bba4d54cdd9ebc4f408947cddc 2023-11-08 22:54:10,312 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/b919f6bba4d54cdd9ebc4f408947cddc as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc 2023-11-08 22:54:10,315 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc, entries=1, sequenceid=37, filesize=5.0 K 2023-11-08 22:54:10,316 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 832ms, sequenceid=37, compaction requested=true 2023-11-08 22:54:10,316 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:10,316 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:10,316 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:10,316 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:10,316 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,316 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:10,316 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:10,317 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,317 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:10,318 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,318 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20c82999[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:10,319 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:10,319 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,319 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:10,320 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,320 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:10,320 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,320 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:10,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:10,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:10,323 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:10,323 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:10,323 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:10,323 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,323 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:10,324 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,324 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:10,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,324 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:10,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:10,325 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:10,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,326 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:10,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:10,328 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:10,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:10,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:10,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:10,328 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:10,429 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:10,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:10,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:10,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:10,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,440 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:10,440 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:10,440 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-08 22:54:10,440 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-08 22:54:10,441 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,441 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,442 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:10,442 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:10,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:10,443 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:10,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,443 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:10,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:10,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,445 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,445 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-08 22:54:10,445 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:10,445 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-08 22:54:10,445 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:10,445 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-08 22:54:10,445 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:54:10,446 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:10,446 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:10,446 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. started... 2023-11-08 22:54:10,446 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 1ba213ea03a0da8d4bf57368d963be5e 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:54:10,861 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120e455956f4d22421b92833ac8c127e0be to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e455956f4d22421b92833ac8c127e0be 2023-11-08 22:54:11,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/1b57cd405dd64a24966cfd52f527ad99 2023-11-08 22:54:11,279 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/1b57cd405dd64a24966cfd52f527ad99 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99 2023-11-08 22:54:11,286 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99, entries=1, sequenceid=41, filesize=5.0 K 2023-11-08 22:54:11,288 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1ba213ea03a0da8d4bf57368d963be5e in 842ms, sequenceid=41, compaction requested=true 2023-11-08 22:54:11,288 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:11,288 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:11,288 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:54:11,288 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:54:11,288 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,288 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-08 22:54:11,288 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-08 22:54:11,290 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,290 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:11,290 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,290 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:11,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:11,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-08 22:54:11,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50d3c72d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:11,292 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-08 22:54:11,292 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,292 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-08 22:54:11,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-08 22:54:11,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:11,293 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,293 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:11,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-08 22:54:11,293 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:11,294 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:11,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:11,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:11,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-08 22:54:11,296 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-08 22:54:11,296 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:11,296 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:11,296 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,296 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:11,298 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,298 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:11,298 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:11,298 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,299 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,301 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:11,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-08 22:54:11,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:11,301 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:11,401 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:11,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:11,405 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:11,408 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:11,409 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:11,411 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484651411 2023-11-08 22:54:11,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:11,415 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:54:11,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-08 22:54:11,416 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:11,417 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x5a812fc3 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:11,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1434da6e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:11,422 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,263 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031df9a50a0bce43aabc144f950019af7c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601031df9a50a0bce43aabc144f950019af7c 2023-11-08 22:54:12,264 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:12,278 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:12,279 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:12,286 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:54:12,287 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:54:12,295 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0d090f1df0184fd487d42a63a4913e68 first=Optional[r3] last=Optional[r6] 2023-11-08 22:54:12,297 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0d090f1df0184fd487d42a63a4913e68}] 2023-11-08 22:54:12,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0d090f1df0184fd487d42a63a4913e68 for inclusion in 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-08 22:54:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:54:12,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:12,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0d090f1df0184fd487d42a63a4913e68 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1c2r7chfb7oi9qfhbdgll2nhg1ioqnrdqkoq37ehhd3hqcg1f5bk2755vobmjdq/family1/0d090f1df0184fd487d42a63a4913e68 2023-11-08 22:54:12,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1c2r7chfb7oi9qfhbdgll2nhg1ioqnrdqkoq37ehhd3hqcg1f5bk2755vobmjdq/family1/0d090f1df0184fd487d42a63a4913e68 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_ 2023-11-08 22:54:12,312 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1c2r7chfb7oi9qfhbdgll2nhg1ioqnrdqkoq37ehhd3hqcg1f5bk2755vobmjdq/family1/0d090f1df0184fd487d42a63a4913e68 into 1ba213ea03a0da8d4bf57368d963be5e/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_ - updating store file list. 2023-11-08 22:54:12,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_ into 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:12,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1c2r7chfb7oi9qfhbdgll2nhg1ioqnrdqkoq37ehhd3hqcg1f5bk2755vobmjdq/family1/0d090f1df0184fd487d42a63a4913e68 into 1ba213ea03a0da8d4bf57368d963be5e/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_) 2023-11-08 22:54:12,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__o1c2r7chfb7oi9qfhbdgll2nhg1ioqnrdqkoq37ehhd3hqcg1f5bk2755vobmjdq/family1/0d090f1df0184fd487d42a63a4913e68 2023-11-08 22:54:12,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:54:12,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:54:12,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 1ba213ea03a0da8d4bf57368d963be5e/family1 is initiating minor compaction 2023-11-08 22:54:12,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6dd7903d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:12,325 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ba213ea03a0da8d4bf57368d963be5e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:12,325 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp, totalSize=50.3 K 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting ad421cf2d4294ffe899e3aa7344a9dac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 86c5dc0a92df4a5b8a6a75ceb0fec5c6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 95a143fe6de541a38228bc98b742f512, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting db906719438b40ccb223718694d23b5d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a799e993bc9c402fa5073cb14bd04368, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting a2b8f91282a54601813007751eace88e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 5f3a72dd4e4749acb95d298c965b5ac5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting b919f6bba4d54cdd9ebc4f408947cddc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:54:12,326 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 1b57cd405dd64a24966cfd52f527ad99, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:54:12,327 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:54:12,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:12,328 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:12,330 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286d5a3c39c1824e46a6c64ab3cdf745a8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512286d5a3c39c1824e46a6c64ab3cdf745a8 2023-11-08 22:54:12,331 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231979e1a8026ff4d659de7369938aad3c5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231979e1a8026ff4d659de7369938aad3c5 2023-11-08 22:54:12,332 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101abba088927c540999dee3388596ffce1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101abba088927c540999dee3388596ffce1 2023-11-08 22:54:12,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c563d220fade4a1f89fc849081e08ca2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103c563d220fade4a1f89fc849081e08ca2 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-08 22:54:12,334 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,334 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:12,370 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ba213ea03a0da8d4bf57368d963be5e#family1#compaction#71 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:12,796 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/5271c51aa6684571b03d75ad8c05e981 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5271c51aa6684571b03d75ad8c05e981 2023-11-08 22:54:12,803 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1ba213ea03a0da8d4bf57368d963be5e/family1 of 1ba213ea03a0da8d4bf57368d963be5e into 5271c51aa6684571b03d75ad8c05e981(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:12,803 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:12,803 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1699484052325; duration=0sec 2023-11-08 22:54:12,804 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:12,900 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_] to archive 2023-11-08 22:54:12,901 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:12,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/ad421cf2d4294ffe899e3aa7344a9dac 2023-11-08 22:54:12,903 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/86c5dc0a92df4a5b8a6a75ceb0fec5c6 2023-11-08 22:54:12,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/95a143fe6de541a38228bc98b742f512 2023-11-08 22:54:12,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/db906719438b40ccb223718694d23b5d 2023-11-08 22:54:12,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a799e993bc9c402fa5073cb14bd04368 2023-11-08 22:54:12,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/a2b8f91282a54601813007751eace88e 2023-11-08 22:54:12,908 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5f3a72dd4e4749acb95d298c965b5ac5 2023-11-08 22:54:12,909 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b919f6bba4d54cdd9ebc4f408947cddc 2023-11-08 22:54:12,910 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1b57cd405dd64a24966cfd52f527ad99 2023-11-08 22:54:12,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/1c67880b21ed4f4da3ecb785a91ccbbf_SeqId_44_ 2023-11-08 22:54:13,204 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205e8c5578a53404383a05a3990600fdf05 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205e8c5578a53404383a05a3990600fdf05 2023-11-08 22:54:13,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:13,234 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f8f0674914594131bcc50101830ebe28 first=Optional[r00] last=Optional[r2] 2023-11-08 22:54:13,235 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f8f0674914594131bcc50101830ebe28}] 2023-11-08 22:54:13,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f8f0674914594131bcc50101830ebe28 for inclusion in 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:13,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-08 22:54:13,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:54:13,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:13,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f8f0674914594131bcc50101830ebe28 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m2maledj14e8r62acub2tbs3grcr8icpdvusle9ld2g7ugjl0ljreca8fqi7cm1t/family1/f8f0674914594131bcc50101830ebe28 2023-11-08 22:54:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m2maledj14e8r62acub2tbs3grcr8icpdvusle9ld2g7ugjl0ljreca8fqi7cm1t/family1/f8f0674914594131bcc50101830ebe28 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_ 2023-11-08 22:54:13,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m2maledj14e8r62acub2tbs3grcr8icpdvusle9ld2g7ugjl0ljreca8fqi7cm1t/family1/f8f0674914594131bcc50101830ebe28 into 1ba213ea03a0da8d4bf57368d963be5e/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_ - updating store file list. 2023-11-08 22:54:13,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_ into 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:13,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m2maledj14e8r62acub2tbs3grcr8icpdvusle9ld2g7ugjl0ljreca8fqi7cm1t/family1/f8f0674914594131bcc50101830ebe28 into 1ba213ea03a0da8d4bf57368d963be5e/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_) 2023-11-08 22:54:13,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__m2maledj14e8r62acub2tbs3grcr8icpdvusle9ld2g7ugjl0ljreca8fqi7cm1t/family1/f8f0674914594131bcc50101830ebe28 2023-11-08 22:54:13,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:54:13,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:54:13,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 1ba213ea03a0da8d4bf57368d963be5e/family1 is initiating minor compaction (all files) 2023-11-08 22:54:13,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@12dd1df8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:13,253 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 1ba213ea03a0da8d4bf57368d963be5e/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:13,253 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5271c51aa6684571b03d75ad8c05e981, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp, totalSize=388.1 K 2023-11-08 22:54:13,254 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 9011736c75564fec92f9f93468ecb998, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850434 2023-11-08 22:54:13,254 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 5271c51aa6684571b03d75ad8c05e981, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250434 2023-11-08 22:54:13,255 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 28d40511e30243f39ca357657e81970b_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878850434 2023-11-08 22:54:13,255 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:13,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:13,257 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113035d274f37a0747068092da6b5345d45a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113035d274f37a0747068092da6b5345d45a 2023-11-08 22:54:13,259 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201819346b0b37d44d487d76f21c6626894 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201819346b0b37d44d487d76f21c6626894 2023-11-08 22:54:13,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ca7b98886274ca89a2bdc50f1c1153c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052ca7b98886274ca89a2bdc50f1c1153c 2023-11-08 22:54:13,260 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-08 22:54:13,260 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-08 22:54:13,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:13,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:13,261 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:13,262 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:13,263 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8550 sec 2023-11-08 22:54:13,273 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1ba213ea03a0da8d4bf57368d963be5e#family1#compaction#72 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:13,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-08 22:54:13,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:13,365 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:13,366 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a812fc3 to 127.0.0.1:56299 2023-11-08 22:54:13,366 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:13,366 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:13,366 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ef075d5 to 127.0.0.1:56299 2023-11-08 22:54:13,366 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:13,368 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60ce7913 to 127.0.0.1:56299 2023-11-08 22:54:13,368 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:13,370 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:13,370 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b48a75c to 127.0.0.1:56299 2023-11-08 22:54:13,370 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:13,370 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:13,370 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c28410f to 127.0.0.1:56299 2023-11-08 22:54:13,370 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:13,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-08 22:54:13,776 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:13,777 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-08 22:54:13,781 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-08 22:54:13,785 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE}] 2023-11-08 22:54:13,786 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE 2023-11-08 22:54:13,787 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:13,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484053787"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484053787"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484053787"}]},"ts":"1699484053787"} 2023-11-08 22:54:13,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:13,940 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:13,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1ba213ea03a0da8d4bf57368d963be5e, disabling compactions & flushes 2023-11-08 22:54:13,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,100 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/.tmp/family1/b74600de5ebd4b64867f7c15c8252455 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b74600de5ebd4b64867f7c15c8252455 2023-11-08 22:54:14,108 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1ba213ea03a0da8d4bf57368d963be5e/family1 of 1ba213ea03a0da8d4bf57368d963be5e into b74600de5ebd4b64867f7c15c8252455(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:14,108 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:14,108 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,108 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1699484053253; duration=0sec 2023-11-08 22:54:14,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. after waiting 0 ms 2023-11-08 22:54:14,109 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:14,109 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,112 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5271c51aa6684571b03d75ad8c05e981, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_] to archive 2023-11-08 22:54:14,113 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:14,115 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/9011736c75564fec92f9f93468ecb998 2023-11-08 22:54:14,117 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5271c51aa6684571b03d75ad8c05e981 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/5271c51aa6684571b03d75ad8c05e981 2023-11-08 22:54:14,118 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/28d40511e30243f39ca357657e81970b_SeqId_47_ 2023-11-08 22:54:14,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-08 22:54:14,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:14,126 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 1ba213ea03a0da8d4bf57368d963be5e to self. 2023-11-08 22:54:14,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,129 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=CLOSED 2023-11-08 22:54:14,129 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484054129"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484054129"}]},"ts":"1699484054129"} 2023-11-08 22:54:14,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-11-08 22:54:14,133 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133 in 343 msec 2023-11-08 22:54:14,134 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=true 2023-11-08 22:54:14,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:14,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484054284"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484054284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484054284"}]},"ts":"1699484054284"} 2023-11-08 22:54:14,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:14,440 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:14,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ba213ea03a0da8d4bf57368d963be5e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:54:14,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:14,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,451 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,453 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:14,453 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:14,453 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ba213ea03a0da8d4bf57368d963be5e columnFamilyName family1 2023-11-08 22:54:14,460 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b74600de5ebd4b64867f7c15c8252455 2023-11-08 22:54:14,460 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(310): Store=1ba213ea03a0da8d4bf57368d963be5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:14,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,462 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:14,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1ba213ea03a0da8d4bf57368d963be5e; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71320966, jitterRate=0.0627652108669281}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:54:14,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:14,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., pid=63, masterSystemTime=1699484054440 2023-11-08 22:54:14,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:14,468 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:14,468 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484054467"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484054467"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484054467"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484054467"}]},"ts":"1699484054467"} 2023-11-08 22:54:14,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-11-08 22:54:14,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133 in 182 msec 2023-11-08 22:54:14,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-11-08 22:54:14,472 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE in 685 msec 2023-11-08 22:54:14,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-11-08 22:54:14,474 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 691 msec 2023-11-08 22:54:14,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1340 sec 2023-11-08 22:54:14,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-08 22:54:14,478 INFO [Listener at localhost/37975] compactions.TestMobCompactor(278): alter status finished 2023-11-08 22:54:14,479 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:14,480 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:14,481 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:14,481 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:14,481 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484654481 2023-11-08 22:54:14,482 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:54:14,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-08 22:54:14,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:14,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x66b3ab60 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:14,489 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cf7abcb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:14,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:14,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:14,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:14,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:14,489 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:15,325 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112825fc49ff427247a199e1322210879ff4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112825fc49ff427247a199e1322210879ff4 2023-11-08 22:54:15,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:15,341 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:15,342 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:15,348 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:54:15,349 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:54:15,358 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/04aa17e2d17941abaf6c6f6b226cc674 first=Optional[r05] last=Optional[r8] 2023-11-08 22:54:15,358 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=51 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/04aa17e2d17941abaf6c6f6b226cc674}] 2023-11-08 22:54:15,363 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/04aa17e2d17941abaf6c6f6b226cc674 for inclusion in 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:15,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-08 22:54:15,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:54:15,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:15,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/04aa17e2d17941abaf6c6f6b226cc674 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cqfchetp5uq91c7j35dh4pve1131e0oq4q1hrin9anpgb1rkf7jabpb5e5spiv0s/family1/04aa17e2d17941abaf6c6f6b226cc674 2023-11-08 22:54:15,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cqfchetp5uq91c7j35dh4pve1131e0oq4q1hrin9anpgb1rkf7jabpb5e5spiv0s/family1/04aa17e2d17941abaf6c6f6b226cc674 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/4c515933b45f440b879b03d9fda224fa_SeqId_53_ 2023-11-08 22:54:15,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cqfchetp5uq91c7j35dh4pve1131e0oq4q1hrin9anpgb1rkf7jabpb5e5spiv0s/family1/04aa17e2d17941abaf6c6f6b226cc674 into 1ba213ea03a0da8d4bf57368d963be5e/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/4c515933b45f440b879b03d9fda224fa_SeqId_53_ - updating store file list. 2023-11-08 22:54:15,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/4c515933b45f440b879b03d9fda224fa_SeqId_53_ into 1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:15,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cqfchetp5uq91c7j35dh4pve1131e0oq4q1hrin9anpgb1rkf7jabpb5e5spiv0s/family1/04aa17e2d17941abaf6c6f6b226cc674 into 1ba213ea03a0da8d4bf57368d963be5e/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/4c515933b45f440b879b03d9fda224fa_SeqId_53_) 2023-11-08 22:54:15,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cqfchetp5uq91c7j35dh4pve1131e0oq4q1hrin9anpgb1rkf7jabpb5e5spiv0s/family1/04aa17e2d17941abaf6c6f6b226cc674 2023-11-08 22:54:15,377 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:15,378 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:15,379 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e455956f4d22421b92833ac8c127e0be to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120e455956f4d22421b92833ac8c127e0be 2023-11-08 22:54:15,380 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511288871012646234cd98b3b418c08d0ec89 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511288871012646234cd98b3b418c08d0ec89 2023-11-08 22:54:15,380 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-08 22:54:15,380 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-08 22:54:15,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:15,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:15,380 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:15,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:15,380 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:15,381 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:15,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 902 msec 2023-11-08 22:54:15,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-08 22:54:15,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:15,851 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-08 22:54:15,853 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-08 22:54:15,853 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-08 22:54:15,856 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-08 22:54:15,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE}] 2023-11-08 22:54:15,861 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE 2023-11-08 22:54:15,862 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:15,863 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484055862"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484055862"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484055862"}]},"ts":"1699484055862"} 2023-11-08 22:54:15,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:16,016 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:16,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,017 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1ba213ea03a0da8d4bf57368d963be5e, disabling compactions & flushes 2023-11-08 22:54:16,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. after waiting 0 ms 2023-11-08 22:54:16,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-08 22:54:16,035 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:16,035 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 1ba213ea03a0da8d4bf57368d963be5e to self. 2023-11-08 22:54:16,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=CLOSED 2023-11-08 22:54:16,038 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484056038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484056038"}]},"ts":"1699484056038"} 2023-11-08 22:54:16,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-11-08 22:54:16,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133 in 176 msec 2023-11-08 22:54:16,044 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=true 2023-11-08 22:54:16,194 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:16,195 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484056194"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484056194"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484056194"}]},"ts":"1699484056194"} 2023-11-08 22:54:16,199 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:16,353 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:16,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ba213ea03a0da8d4bf57368d963be5e, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:54:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,363 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,366 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:16,366 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1 2023-11-08 22:54:16,367 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ba213ea03a0da8d4bf57368d963be5e columnFamilyName family1 2023-11-08 22:54:16,376 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/4c515933b45f440b879b03d9fda224fa_SeqId_53_ 2023-11-08 22:54:16,380 DEBUG [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/family1/b74600de5ebd4b64867f7c15c8252455 2023-11-08 22:54:16,380 INFO [StoreOpener-1ba213ea03a0da8d4bf57368d963be5e-1] regionserver.HStore(310): Store=1ba213ea03a0da8d4bf57368d963be5e/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:16,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:54:16,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1ba213ea03a0da8d4bf57368d963be5e; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74924207, jitterRate=0.11645768582820892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:54:16,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:54:16,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e., pid=69, masterSystemTime=1699484056353 2023-11-08 22:54:16,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:54:16,387 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1ba213ea03a0da8d4bf57368d963be5e, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:16,387 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1699484056387"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484056387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484056387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484056387"}]},"ts":"1699484056387"} 2023-11-08 22:54:16,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-11-08 22:54:16,389 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 1ba213ea03a0da8d4bf57368d963be5e, server=jenkins-hbase20.apache.org,35543,1699483966133 in 189 msec 2023-11-08 22:54:16,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-11-08 22:54:16,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1ba213ea03a0da8d4bf57368d963be5e, REOPEN/MOVE in 529 msec 2023-11-08 22:54:16,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-11-08 22:54:16,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 535 msec 2023-11-08 22:54:16,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 953 msec 2023-11-08 22:54:16,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-08 22:54:16,396 INFO [Listener at localhost/37975] compactions.TestMobCompactor(278): alter status finished 2023-11-08 22:54:16,397 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-08 22:54:16,398 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:16,399 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:16,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:16,400 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484656400 2023-11-08 22:54:16,400 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:54:16,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-08 22:54:16,401 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:16,403 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x330c4d83 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:16,407 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@afc30e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-08 22:54:16,408 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-08 22:54:16,408 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:16,409 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-08 22:54:16,411 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 12 msec 2023-11-08 22:54:16,456 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240 (was 247), OpenFileDescriptor=637 (was 645), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 215), ProcessCount=167 (was 167), AvailableMemoryMB=5954 (was 6002) 2023-11-08 22:54:16,466 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=167, AvailableMemoryMB=5954 2023-11-08 22:54:16,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-08 22:54:16,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:16,471 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:54:16,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-08 22:54:16,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:54:16,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:16,473 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:16,473 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 empty. 2023-11-08 22:54:16,474 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:16,474 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-08 22:54:16,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:16,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:16,884 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:16,887 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => abb2b580a3c3c22f006ee42cf812b130, NAME => 'testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:17,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:17,298 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:17,299 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing abb2b580a3c3c22f006ee42cf812b130, disabling compactions & flushes 2023-11-08 22:54:17,299 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,299 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,299 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. after waiting 0 ms 2023-11-08 22:54:17,299 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,299 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,299 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:17,304 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:54:17,306 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699484057306"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484057306"}]},"ts":"1699484057306"} 2023-11-08 22:54:17,307 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:54:17,308 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:54:17,308 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484057308"}]},"ts":"1699484057308"} 2023-11-08 22:54:17,309 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-08 22:54:17,313 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, ASSIGN}] 2023-11-08 22:54:17,315 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, ASSIGN 2023-11-08 22:54:17,316 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:17,467 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=abb2b580a3c3c22f006ee42cf812b130, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:17,468 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699484057467"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484057467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484057467"}]},"ts":"1699484057467"} 2023-11-08 22:54:17,470 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure abb2b580a3c3c22f006ee42cf812b130, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:17,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:17,623 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:17,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abb2b580a3c3c22f006ee42cf812b130, NAME => 'testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:54:17,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-08 22:54:17,630 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-08 22:54:17,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:17,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,630 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,632 INFO [StoreOpener-abb2b580a3c3c22f006ee42cf812b130-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,635 DEBUG [StoreOpener-abb2b580a3c3c22f006ee42cf812b130-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1 2023-11-08 22:54:17,636 DEBUG [StoreOpener-abb2b580a3c3c22f006ee42cf812b130-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1 2023-11-08 22:54:17,636 INFO [StoreOpener-abb2b580a3c3c22f006ee42cf812b130-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abb2b580a3c3c22f006ee42cf812b130 columnFamilyName f1 2023-11-08 22:54:17,639 INFO [StoreOpener-abb2b580a3c3c22f006ee42cf812b130-1] regionserver.HStore(310): Store=abb2b580a3c3c22f006ee42cf812b130/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:17,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:17,647 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:17,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened abb2b580a3c3c22f006ee42cf812b130; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68099207, jitterRate=0.01475726068019867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:54:17,648 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:17,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130., pid=73, masterSystemTime=1699484057623 2023-11-08 22:54:17,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,650 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:17,650 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=abb2b580a3c3c22f006ee42cf812b130, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:17,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699484057650"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484057650"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484057650"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484057650"}]},"ts":"1699484057650"} 2023-11-08 22:54:17,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-11-08 22:54:17,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure abb2b580a3c3c22f006ee42cf812b130, server=jenkins-hbase20.apache.org,35543,1699483966133 in 181 msec 2023-11-08 22:54:17,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-11-08 22:54:17,654 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, ASSIGN in 339 msec 2023-11-08 22:54:17,654 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:54:17,654 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484057654"}]},"ts":"1699484057654"} 2023-11-08 22:54:17,655 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-08 22:54:17,657 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:54:17,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1880 sec 2023-11-08 22:54:18,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-08 22:54:18,582 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-08 22:54:18,582 DEBUG [Listener at localhost/37975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-08 22:54:18,587 INFO [Listener at localhost/37975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-08 22:54:18,592 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-08 22:54:18,592 INFO [Listener at localhost/37975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-08 22:54:18,592 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-08 22:54:18,596 INFO [Listener at localhost/37975] regionserver.HRegion(2745): Flushing abb2b580a3c3c22f006ee42cf812b130 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-08 22:54:18,709 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:18,710 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66b3ab60 to 127.0.0.1:56299 2023-11-08 22:54:18,710 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:18,711 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x330c4d83 to 127.0.0.1:56299 2023-11-08 22:54:18,712 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:19,130 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311080a1dbc67c3604874948f32518e76066a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311080a1dbc67c3604874948f32518e76066a 2023-11-08 22:54:19,537 INFO [Listener at localhost/37975] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp/f1/0d1eee46075a4eb69fe38b3cb897d3ce 2023-11-08 22:54:19,550 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp/f1/0d1eee46075a4eb69fe38b3cb897d3ce as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce 2023-11-08 22:54:19,555 INFO [Listener at localhost/37975] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce, entries=1, sequenceid=5, filesize=4.9 K 2023-11-08 22:54:19,557 INFO [Listener at localhost/37975] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for abb2b580a3c3c22f006ee42cf812b130 in 961ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:19,557 DEBUG [Listener at localhost/37975] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-08 22:54:19,557 DEBUG [Listener at localhost/37975] regionserver.HRegion(2446): Flush status journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:19,560 INFO [Listener at localhost/37975] regionserver.HRegion(2745): Flushing abb2b580a3c3c22f006ee42cf812b130 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-08 22:54:19,669 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:54:19,973 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108dde250474ff04cff9c4c12f0e7bfac64 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108dde250474ff04cff9c4c12f0e7bfac64 2023-11-08 22:54:20,380 INFO [Listener at localhost/37975] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp/f1/6d538c5a52294c67affcec9a1d93db73 2023-11-08 22:54:20,386 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp/f1/6d538c5a52294c67affcec9a1d93db73 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73 2023-11-08 22:54:20,391 INFO [Listener at localhost/37975] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73, entries=1, sequenceid=9, filesize=4.9 K 2023-11-08 22:54:20,392 INFO [Listener at localhost/37975] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for abb2b580a3c3c22f006ee42cf812b130 in 832ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:20,392 DEBUG [Listener at localhost/37975] regionserver.HRegion(2446): Flush status journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:20,394 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-08 22:54:20,395 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-08 22:54:20,396 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-08 22:54:20,397 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:20,397 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484660397 2023-11-08 22:54:20,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:54:20,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-08 22:54:20,398 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-08 22:54:20,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x484d4d22 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:20,404 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23dd27d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:20,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231108 for table='testGetAfterCompaction' and column='f1' 2023-11-08 22:54:20,446 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,446 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,497 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,497 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,548 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,548 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,599 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,600 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,651 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,651 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,703 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,703 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,755 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,755 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,807 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,807 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,859 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,859 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,910 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,910 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,961 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:20,961 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,013 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,013 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,065 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,065 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,117 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,117 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,169 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,169 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,221 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,221 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,247 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108e13d270b47504d638982e5d505a85b18 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108e13d270b47504d638982e5d505a85b18 2023-11-08 22:54:21,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testGetAfterCompaction' column='f1' 2023-11-08 22:54:21,264 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:21,265 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:21,271 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:54:21,272 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,272 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,273 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:54:21,282 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/f1/b1e4382a367b4655abd956b88b8c2910 first=Optional[r1] last=Optional[r2] 2023-11-08 22:54:21,283 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{f1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/f1/b1e4382a367b4655abd956b88b8c2910}] 2023-11-08 22:54:21,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/f1/b1e4382a367b4655abd956b88b8c2910 for inclusion in abb2b580a3c3c22f006ee42cf812b130/f1 2023-11-08 22:54:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-08 22:54:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:54:21,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:21,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/f1/b1e4382a367b4655abd956b88b8c2910 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testGetAfterCompaction__1vi52jrs6tf3c977j7t4e8va1ep4mlb9p20o5k8bp2mvj6krirlvb7i0ms12lc80/f1/b1e4382a367b4655abd956b88b8c2910 2023-11-08 22:54:21,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testGetAfterCompaction__1vi52jrs6tf3c977j7t4e8va1ep4mlb9p20o5k8bp2mvj6krirlvb7i0ms12lc80/f1/b1e4382a367b4655abd956b88b8c2910 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_ 2023-11-08 22:54:21,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testGetAfterCompaction__1vi52jrs6tf3c977j7t4e8va1ep4mlb9p20o5k8bp2mvj6krirlvb7i0ms12lc80/f1/b1e4382a367b4655abd956b88b8c2910 into abb2b580a3c3c22f006ee42cf812b130/f1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_ - updating store file list. 2023-11-08 22:54:21,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_ into abb2b580a3c3c22f006ee42cf812b130/f1 2023-11-08 22:54:21,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testGetAfterCompaction__1vi52jrs6tf3c977j7t4e8va1ep4mlb9p20o5k8bp2mvj6krirlvb7i0ms12lc80/f1/b1e4382a367b4655abd956b88b8c2910 into abb2b580a3c3c22f006ee42cf812b130/f1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_) 2023-11-08 22:54:21,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testGetAfterCompaction__1vi52jrs6tf3c977j7t4e8va1ep4mlb9p20o5k8bp2mvj6krirlvb7i0ms12lc80/f1/b1e4382a367b4655abd956b88b8c2910 2023-11-08 22:54:21,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): abb2b580a3c3c22f006ee42cf812b130/f1 is initiating minor compaction 2023-11-08 22:54:21,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@73cd7be2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-08 22:54:21,301 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of abb2b580a3c3c22f006ee42cf812b130/f1 in testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:21,301 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp, totalSize=10.0 K 2023-11-08 22:54:21,302 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 6d538c5a52294c67affcec9a1d93db73, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:54:21,302 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:54:21,303 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testGetAfterCompaction' column='f1' 2023-11-08 22:54:21,304 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:21,305 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311080a1dbc67c3604874948f32518e76066a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311080a1dbc67c3604874948f32518e76066a 2023-11-08 22:54:21,307 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108dde250474ff04cff9c4c12f0e7bfac64 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108dde250474ff04cff9c4c12f0e7bfac64 2023-11-08 22:54:21,307 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-08 22:54:21,307 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231108' 2023-11-08 22:54:21,307 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231108 for table='testGetAfterCompaction' and column='f1' 2023-11-08 22:54:21,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-08 22:54:21,307 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:54:21,308 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-08 22:54:21,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 913 msec 2023-11-08 22:54:21,311 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): abb2b580a3c3c22f006ee42cf812b130#f1#compaction#75 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:21,323 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,323 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,323 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,327 DEBUG [Listener at localhost/37975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-08 22:54:21,330 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-08 22:54:21,330 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35543] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:21,331 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-08 22:54:21,331 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-08 22:54:21,331 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35543] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-08 22:54:21,331 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=35543] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. because compaction request was cancelled 2023-11-08 22:54:21,383 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,383 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,383 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,434 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,434 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,434 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,485 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,485 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,485 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,536 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,536 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,536 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,587 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,587 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,587 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,638 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,638 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,638 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,689 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,689 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,689 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,740 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,740 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,740 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,791 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,791 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,791 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,842 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,842 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,842 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,893 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,893 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,893 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,945 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,945 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,945 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:21,996 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,997 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:21,997 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:22,049 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,049 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,049 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:22,101 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,101 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,101 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:22,137 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/.tmp/f1/6902ee114e7c452995f0e4b82b2692bf as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6902ee114e7c452995f0e4b82b2692bf 2023-11-08 22:54:22,143 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in abb2b580a3c3c22f006ee42cf812b130/f1 of abb2b580a3c3c22f006ee42cf812b130 into 6902ee114e7c452995f0e4b82b2692bf(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:22,143 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:22,144 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1699484061301; duration=0sec 2023-11-08 22:54:22,144 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:22,152 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,152 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6902ee114e7c452995f0e4b82b2692bf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699484062123; access_time=1699484061306; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,153 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484060380; access_time=1699484059562; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,153 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1699484061235; access_time=1699484060418; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-08 22:54:22,189 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_] to archive 2023-11-08 22:54:22,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:22,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6d538c5a52294c67affcec9a1d93db73 2023-11-08 22:54:22,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/eaf5ecbdb1874ca99fa556c6a9fd57a2_SeqId_12_ 2023-11-08 22:54:22,203 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1699484059536; access_time=1699484058714; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,203 INFO [Listener at localhost/37975] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6902ee114e7c452995f0e4b82b2692bf; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1699484062123; access_time=1699484061306; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-08 22:54:22,321 INFO [Listener at localhost/37975] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-08 22:54:22,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-11-08 22:54:22,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,335 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484062335"}]},"ts":"1699484062335"} 2023-11-08 22:54:22,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-08 22:54:22,337 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-08 22:54:22,338 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-08 22:54:22,339 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, UNASSIGN}] 2023-11-08 22:54:22,340 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, UNASSIGN 2023-11-08 22:54:22,341 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=abb2b580a3c3c22f006ee42cf812b130, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:22,341 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699484062341"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484062341"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484062341"}]},"ts":"1699484062341"} 2023-11-08 22:54:22,342 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure abb2b580a3c3c22f006ee42cf812b130, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:22,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-08 22:54:22,493 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:22,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:22,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing abb2b580a3c3c22f006ee42cf812b130, disabling compactions & flushes 2023-11-08 22:54:22,494 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:22,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:22,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. after waiting 0 ms 2023-11-08 22:54:22,494 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:22,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-08 22:54:22,503 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-08 22:54:22,505 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130. 2023-11-08 22:54:22,505 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for abb2b580a3c3c22f006ee42cf812b130: 2023-11-08 22:54:22,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:22,508 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=abb2b580a3c3c22f006ee42cf812b130, regionState=CLOSED 2023-11-08 22:54:22,508 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1699484062508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484062508"}]},"ts":"1699484062508"} 2023-11-08 22:54:22,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-11-08 22:54:22,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure abb2b580a3c3c22f006ee42cf812b130, server=jenkins-hbase20.apache.org,35543,1699483966133 in 167 msec 2023-11-08 22:54:22,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-11-08 22:54:22,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=abb2b580a3c3c22f006ee42cf812b130, UNASSIGN in 172 msec 2023-11-08 22:54:22,514 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484062514"}]},"ts":"1699484062514"} 2023-11-08 22:54:22,515 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-08 22:54:22,517 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-08 22:54:22,519 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 190 msec 2023-11-08 22:54:22,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-08 22:54:22,641 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-08 22:54:22,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-11-08 22:54:22,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,657 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,659 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-08 22:54:22,661 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:22,664 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1, FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/recovered.edits] 2023-11-08 22:54:22,668 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/0d1eee46075a4eb69fe38b3cb897d3ce 2023-11-08 22:54:22,670 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6902ee114e7c452995f0e4b82b2692bf to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/f1/6902ee114e7c452995f0e4b82b2692bf 2023-11-08 22:54:22,672 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/recovered.edits/15.seqid to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130/recovered.edits/15.seqid 2023-11-08 22:54:22,673 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testGetAfterCompaction/abb2b580a3c3c22f006ee42cf812b130 2023-11-08 22:54:22,673 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-08 22:54:22,673 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-08 22:54:22,674 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-08 22:54:22,677 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108e13d270b47504d638982e5d505a85b18 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231108e13d270b47504d638982e5d505a85b18 2023-11-08 22:54:22,678 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-08 22:54:22,680 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,699 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-08 22:54:22,702 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-08 22:54:22,703 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,703 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-08 22:54:22,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699484062703"}]},"ts":"9223372036854775807"} 2023-11-08 22:54:22,705 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-08 22:54:22,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => abb2b580a3c3c22f006ee42cf812b130, NAME => 'testGetAfterCompaction,,1699484056469.abb2b580a3c3c22f006ee42cf812b130.', STARTKEY => '', ENDKEY => ''}] 2023-11-08 22:54:22,705 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-08 22:54:22,705 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1699484062705"}]},"ts":"9223372036854775807"} 2023-11-08 22:54:22,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-08 22:54:22,708 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-08 22:54:22,709 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 56 msec 2023-11-08 22:54:22,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-08 22:54:22,761 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-08 22:54:22,772 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=236 (was 240), OpenFileDescriptor=622 (was 637), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 160), ProcessCount=167 (was 167), AvailableMemoryMB=5921 (was 5954) 2023-11-08 22:54:22,781 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=236, OpenFileDescriptor=622, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=167, AvailableMemoryMB=5921 2023-11-08 22:54:22,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-08 22:54:22,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-08 22:54:22,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:54:22,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-08 22:54:22,786 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:54:22,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b empty. 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 empty. 2023-11-08 22:54:22,788 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 empty. 2023-11-08 22:54:22,789 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:22,789 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:22,789 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:22,789 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-08 22:54:22,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:23,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:23,198 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:23,201 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => aca9d12b860f784b19c77bdc5584176b, NAME => 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:23,201 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => c22d0a51147f42a58be2b892dac41b50, NAME => 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:23,202 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 983a597d793791ee6df1a90889470f48, NAME => 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 983a597d793791ee6df1a90889470f48, disabling compactions & flushes 2023-11-08 22:54:23,212 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. after waiting 0 ms 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,212 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,212 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:23,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:23,613 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,613 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing c22d0a51147f42a58be2b892dac41b50, disabling compactions & flushes 2023-11-08 22:54:23,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing aca9d12b860f784b19c77bdc5584176b, disabling compactions & flushes 2023-11-08 22:54:23,614 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. after waiting 0 ms 2023-11-08 22:54:23,614 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. after waiting 0 ms 2023-11-08 22:54:23,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,615 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:23,616 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,616 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:23,622 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:54:23,624 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484063624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484063624"}]},"ts":"1699484063624"} 2023-11-08 22:54:23,624 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484063624"}]},"ts":"1699484063624"} 2023-11-08 22:54:23,624 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484063624"}]},"ts":"1699484063624"} 2023-11-08 22:54:23,627 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-08 22:54:23,628 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:54:23,628 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484063628"}]},"ts":"1699484063628"} 2023-11-08 22:54:23,630 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-08 22:54:23,634 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN}] 2023-11-08 22:54:23,636 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN 2023-11-08 22:54:23,636 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN 2023-11-08 22:54:23,636 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN 2023-11-08 22:54:23,637 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:23,637 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:23,637 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:23,790 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,790 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,790 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063790"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484063790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484063790"}]},"ts":"1699484063790"} 2023-11-08 22:54:23,790 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,790 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484063790"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484063790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484063790"}]},"ts":"1699484063790"} 2023-11-08 22:54:23,790 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063790"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484063790"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484063790"}]},"ts":"1699484063790"} 2023-11-08 22:54:23,793 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=80, state=RUNNABLE; OpenRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:23,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:23,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:23,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:23,947 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c22d0a51147f42a58be2b892dac41b50, NAME => 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.', STARTKEY => '2', ENDKEY => ''} 2023-11-08 22:54:23,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,953 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,955 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:23,955 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:23,956 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c22d0a51147f42a58be2b892dac41b50 columnFamilyName family1 2023-11-08 22:54:23,958 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(310): Store=c22d0a51147f42a58be2b892dac41b50/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,959 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,961 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2 2023-11-08 22:54:23,961 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2 2023-11-08 22:54:23,961 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c22d0a51147f42a58be2b892dac41b50 columnFamilyName family2 2023-11-08 22:54:23,963 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(310): Store=c22d0a51147f42a58be2b892dac41b50/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:23,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:23,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:23,968 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c22d0a51147f42a58be2b892dac41b50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69056676, jitterRate=0.02902466058731079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:23,968 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:23,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., pid=85, masterSystemTime=1699484063947 2023-11-08 22:54:23,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:23,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 983a597d793791ee6df1a90889470f48, NAME => 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.', STARTKEY => '1', ENDKEY => '2'} 2023-11-08 22:54:23,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,970 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,971 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063970"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484063970"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484063970"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484063970"}]},"ts":"1699484063970"} 2023-11-08 22:54:23,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,972 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=82 2023-11-08 22:54:23,973 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:23,973 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133 in 177 msec 2023-11-08 22:54:23,973 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:23,974 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 983a597d793791ee6df1a90889470f48 columnFamilyName family1 2023-11-08 22:54:23,974 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN in 339 msec 2023-11-08 22:54:23,975 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(310): Store=983a597d793791ee6df1a90889470f48/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,975 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,976 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2 2023-11-08 22:54:23,976 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2 2023-11-08 22:54:23,976 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 983a597d793791ee6df1a90889470f48 columnFamilyName family2 2023-11-08 22:54:23,977 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(310): Store=983a597d793791ee6df1a90889470f48/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:23,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:23,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:23,982 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 983a597d793791ee6df1a90889470f48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70336600, jitterRate=0.04809701442718506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:23,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:23,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., pid=84, masterSystemTime=1699484063947 2023-11-08 22:54:23,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:23,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aca9d12b860f784b19c77bdc5584176b, NAME => 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.', STARTKEY => '', ENDKEY => '1'} 2023-11-08 22:54:23,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,985 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:23,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,985 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484063985"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484063985"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484063985"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484063985"}]},"ts":"1699484063985"} 2023-11-08 22:54:23,986 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,987 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:23,987 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:23,987 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca9d12b860f784b19c77bdc5584176b columnFamilyName family1 2023-11-08 22:54:23,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=81 2023-11-08 22:54:23,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133 in 192 msec 2023-11-08 22:54:23,988 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(310): Store=aca9d12b860f784b19c77bdc5584176b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN in 355 msec 2023-11-08 22:54:23,988 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,990 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2 2023-11-08 22:54:23,990 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2 2023-11-08 22:54:23,990 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca9d12b860f784b19c77bdc5584176b columnFamilyName family2 2023-11-08 22:54:23,991 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(310): Store=aca9d12b860f784b19c77bdc5584176b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:23,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:23,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:23,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:23,996 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aca9d12b860f784b19c77bdc5584176b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64998636, jitterRate=-0.03144484758377075}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:23,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:23,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., pid=83, masterSystemTime=1699484063947 2023-11-08 22:54:23,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:23,999 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:23,999 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484063998"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484063998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484063998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484063998"}]},"ts":"1699484063998"} 2023-11-08 22:54:24,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=80 2023-11-08 22:54:24,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=80, state=SUCCESS; OpenRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 207 msec 2023-11-08 22:54:24,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=80, resume processing ppid=79 2023-11-08 22:54:24,002 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN in 368 msec 2023-11-08 22:54:24,003 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:54:24,003 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484064003"}]},"ts":"1699484064003"} 2023-11-08 22:54:24,004 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-08 22:54:24,006 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:54:24,007 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2230 sec 2023-11-08 22:54:24,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-08 22:54:24,893 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-08 22:54:24,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:24,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:24,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:24,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:24,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-08 22:54:24,913 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-08 22:54:24,913 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:24,913 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-08 22:54:24,913 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-08 22:54:24,913 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:24,913 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:24,914 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:24,914 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:24,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:24,915 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:24,915 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:24,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:24,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:24,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:24,916 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-08 22:54:24,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-08 22:54:24,916 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-08 22:54:24,916 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:24,916 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-08 22:54:24,916 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:24,916 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:24,916 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:24,916 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:24,916 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:24,917 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 983a597d793791ee6df1a90889470f48 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:24,916 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:24,917 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:24,917 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:24,917 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aca9d12b860f784b19c77bdc5584176b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:24,918 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c22d0a51147f42a58be2b892dac41b50 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:25,346 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b 2023-11-08 22:54:25,346 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 2023-11-08 22:54:25,348 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a 2023-11-08 22:54:25,701 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-08 22:54:25,752 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/44ae5eef19084d1b91b3f44870e91ec8 2023-11-08 22:54:25,753 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/5030afd22c944a9ebd79fc1b62c46fba 2023-11-08 22:54:25,756 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/cc48a293aedf407faf9b77c83ffbd95a 2023-11-08 22:54:26,182 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a 2023-11-08 22:54:26,184 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a 2023-11-08 22:54:26,185 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03 2023-11-08 22:54:26,191 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/06dd9b8ac42d418eb39d281d6abc7368 2023-11-08 22:54:26,194 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/5030afd22c944a9ebd79fc1b62c46fba as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba 2023-11-08 22:54:26,198 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:26,199 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/06dd9b8ac42d418eb39d281d6abc7368 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368 2023-11-08 22:54:26,203 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:26,204 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for c22d0a51147f42a58be2b892dac41b50 in 1286ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:26,205 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:26,205 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:26,205 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:26,591 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/a309f4118e874dd988ffefcad65d3fd4 2023-11-08 22:54:26,591 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/fe57dc7787d0443abe8a28b3ba59b3df 2023-11-08 22:54:26,603 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/cc48a293aedf407faf9b77c83ffbd95a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a 2023-11-08 22:54:26,603 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/44ae5eef19084d1b91b3f44870e91ec8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8 2023-11-08 22:54:26,606 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:26,606 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:26,607 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/a309f4118e874dd988ffefcad65d3fd4 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4 2023-11-08 22:54:26,607 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/fe57dc7787d0443abe8a28b3ba59b3df as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df 2023-11-08 22:54:26,610 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:26,610 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:26,611 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 983a597d793791ee6df1a90889470f48 in 1694ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:26,611 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for aca9d12b860f784b19c77bdc5584176b in 1694ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:26,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:26,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:26,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:26,611 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-08 22:54:26,611 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-08 22:54:26,612 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,612 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,613 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:26,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-08 22:54:26,614 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20f52615[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:26,614 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-08 22:54:26,614 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-08 22:54:26,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-08 22:54:26,614 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:26,614 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,614 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:26,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-08 22:54:26,615 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:26,615 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-08 22:54:26,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:26,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:26,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-08 22:54:26,617 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-08 22:54:26,617 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:26,617 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:26,617 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-08 22:54:26,617 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:26,618 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,618 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,618 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:26,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:26,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:26,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:26,619 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:26,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,620 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:26,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,621 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,621 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:26,621 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:26,621 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:26,621 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:26,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:26,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-08 22:54:26,622 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,622 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:26,622 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:26,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:26,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:26,722 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:26,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:26,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:26,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:26,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:26,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:26,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:26,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-08 22:54:26,735 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-08 22:54:26,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:26,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-08 22:54:26,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-08 22:54:26,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:26,737 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:26,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:26,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:26,737 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:26,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-08 22:54:26,738 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-08 22:54:26,738 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-08 22:54:26,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-08 22:54:26,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:26,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:26,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:26,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:26,739 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aca9d12b860f784b19c77bdc5584176b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:26,739 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:26,739 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 983a597d793791ee6df1a90889470f48 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:26,739 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c22d0a51147f42a58be2b892dac41b50 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:26,749 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 2023-11-08 22:54:27,154 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/d706dc4f799e4540951cb0e512bb30c5 2023-11-08 22:54:27,157 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa 2023-11-08 22:54:27,158 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 2023-11-08 22:54:27,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/689a4e0ec8744beba52e7e492e6675e8 2023-11-08 22:54:27,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/313f16f14de148eca08690ccccc59491 2023-11-08 22:54:27,575 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62 2023-11-08 22:54:27,582 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87 2023-11-08 22:54:27,981 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/f08f0ce24b734528b522b9df40e43a0e 2023-11-08 22:54:27,983 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b 2023-11-08 22:54:27,986 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/d706dc4f799e4540951cb0e512bb30c5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5 2023-11-08 22:54:27,988 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/37e6498cdac34d09a50f11e312a0e9c8 2023-11-08 22:54:27,991 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:27,992 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/f08f0ce24b734528b522b9df40e43a0e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e 2023-11-08 22:54:27,992 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/313f16f14de148eca08690ccccc59491 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491 2023-11-08 22:54:27,996 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:27,997 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:27,997 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for aca9d12b860f784b19c77bdc5584176b in 1258ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:27,997 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:27,997 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:27,997 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:27,997 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/37e6498cdac34d09a50f11e312a0e9c8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8 2023-11-08 22:54:28,002 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:28,003 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 983a597d793791ee6df1a90889470f48 in 1264ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:28,003 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:28,003 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:28,003 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:28,006 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:54:28,389 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/f9d9d48625ce4108a3ff8bffae42637a 2023-11-08 22:54:28,400 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/689a4e0ec8744beba52e7e492e6675e8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8 2023-11-08 22:54:28,407 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:28,408 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/f9d9d48625ce4108a3ff8bffae42637a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a 2023-11-08 22:54:28,415 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:28,416 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for c22d0a51147f42a58be2b892dac41b50 in 1677ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:28,417 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:28,417 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:28,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:28,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:28,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-08 22:54:28,417 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-08 22:54:28,419 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,419 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:28,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:28,419 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,420 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:28,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-08 22:54:28,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64819fbb[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:28,422 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-08 22:54:28,422 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,423 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,424 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-08 22:54:28,424 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-08 22:54:28,424 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:28,424 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,424 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:28,425 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-08 22:54:28,425 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:28,425 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,425 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-08 22:54:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:28,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:28,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:28,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-08 22:54:28,429 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-08 22:54:28,429 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:28,429 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:28,429 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-08 22:54:28,429 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:28,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:28,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,431 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:28,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:28,432 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:28,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,434 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:28,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,436 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:28,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-08 22:54:28,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:28,437 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:28,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,437 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:28,438 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:28,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:28,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:28,538 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:28,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:28,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:28,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:28,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:28,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:28,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:28,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-08 22:54:28,554 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-08 22:54:28,554 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:28,554 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-08 22:54:28,554 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-08 22:54:28,555 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,555 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:28,556 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:28,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:28,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:28,557 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:28,557 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:28,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:28,557 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:28,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:28,558 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-08 22:54:28,558 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-08 22:54:28,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-08 22:54:28,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-08 22:54:28,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:28,558 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:28,559 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:28,559 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:28,559 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:28,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aca9d12b860f784b19c77bdc5584176b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:28,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 983a597d793791ee6df1a90889470f48 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:28,559 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c22d0a51147f42a58be2b892dac41b50 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:28,987 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab 2023-11-08 22:54:28,988 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f 2023-11-08 22:54:28,989 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 2023-11-08 22:54:29,010 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/4b5853ca2fa644f0b2122cea28ce7140 2023-11-08 22:54:29,010 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/ab6aa215087d4ab2b53999225e1bd842 2023-11-08 22:54:29,024 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28 2023-11-08 22:54:29,406 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/6f8a8699741b4ff188292c966e6b85c2 2023-11-08 22:54:29,423 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921 2023-11-08 22:54:29,429 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/e457ff627c534b64a0c16b07555292b6 2023-11-08 22:54:29,434 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/4b5853ca2fa644f0b2122cea28ce7140 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140 2023-11-08 22:54:29,439 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:29,440 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/e457ff627c534b64a0c16b07555292b6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6 2023-11-08 22:54:29,446 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:29,447 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for aca9d12b860f784b19c77bdc5584176b in 888ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:29,448 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:29,448 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:29,448 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:29,829 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db 2023-11-08 22:54:29,834 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58 2023-11-08 22:54:29,837 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/ab6aa215087d4ab2b53999225e1bd842 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842 2023-11-08 22:54:29,842 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:29,843 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db 2023-11-08 22:54:29,849 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:29,849 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for c22d0a51147f42a58be2b892dac41b50 in 1290ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:29,849 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:29,849 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:29,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:30,242 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/4a4fb91b675446b98a2c66bc4e6ded21 2023-11-08 22:54:30,255 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/6f8a8699741b4ff188292c966e6b85c2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2 2023-11-08 22:54:30,260 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:30,261 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/4a4fb91b675446b98a2c66bc4e6ded21 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21 2023-11-08 22:54:30,267 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:30,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 983a597d793791ee6df1a90889470f48 in 1709ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:30,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:30,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:30,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:30,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:30,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-08 22:54:30,269 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-08 22:54:30,270 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,270 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:30,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:30,271 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:30,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-08 22:54:30,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@564e653[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:30,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-08 22:54:30,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,274 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-08 22:54:30,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,274 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-08 22:54:30,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:30,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-08 22:54:30,276 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:30,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-08 22:54:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:30,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:30,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:30,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:30,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-08 22:54:30,279 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-08 22:54:30,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:30,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:30,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-08 22:54:30,279 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:30,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:30,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:30,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,281 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:30,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:30,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:30,282 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,283 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:30,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:30,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:30,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-08 22:54:30,286 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:30,286 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,286 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,287 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:30,287 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:30,287 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:30,287 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:30,387 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:30,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:30,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:30,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:30,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:30,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:30,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:30,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-08 22:54:30,400 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-08 22:54:30,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:30,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-08 22:54:30,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-08 22:54:30,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:30,402 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:30,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:30,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:30,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:30,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:30,402 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:30,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:30,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:30,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-08 22:54:30,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-08 22:54:30,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-08 22:54:30,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-08 22:54:30,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:30,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:30,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:30,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:30,403 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 983a597d793791ee6df1a90889470f48 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:30,403 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:30,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c22d0a51147f42a58be2b892dac41b50 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:30,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aca9d12b860f784b19c77bdc5584176b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:30,822 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 2023-11-08 22:54:30,823 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 2023-11-08 22:54:30,823 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece 2023-11-08 22:54:31,229 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/9718e5be30714088bec009f2be878e2d 2023-11-08 22:54:31,229 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/c548a780c85740a189651dca9c331e06 2023-11-08 22:54:31,230 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/eeeb316e93b444c0bb7db84e13878b44 2023-11-08 22:54:31,656 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747 2023-11-08 22:54:31,656 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3 2023-11-08 22:54:31,656 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e 2023-11-08 22:54:31,662 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 2023-11-08 22:54:31,664 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/624ec3cf35f64001a251bd316b8f8ce5 2023-11-08 22:54:31,666 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/c548a780c85740a189651dca9c331e06 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06 2023-11-08 22:54:31,667 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/9718e5be30714088bec009f2be878e2d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d 2023-11-08 22:54:31,670 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:31,671 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:31,671 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 2023-11-08 22:54:31,671 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/624ec3cf35f64001a251bd316b8f8ce5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5 2023-11-08 22:54:31,674 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:31,674 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:31,675 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for c22d0a51147f42a58be2b892dac41b50 in 1272ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:31,675 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for aca9d12b860f784b19c77bdc5584176b in 1271ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:31,675 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:31,675 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:31,675 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:31,675 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:31,675 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:31,675 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:32,064 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/93dffcb5ccea45159224b96d7de7b592 2023-11-08 22:54:32,077 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/eeeb316e93b444c0bb7db84e13878b44 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44 2023-11-08 22:54:32,084 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:32,086 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/93dffcb5ccea45159224b96d7de7b592 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592 2023-11-08 22:54:32,092 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:32,093 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 983a597d793791ee6df1a90889470f48 in 1690ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:32,093 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:32,093 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:32,093 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:32,093 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:32,093 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,093 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-08 22:54:32,093 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-08 22:54:32,095 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,095 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:32,095 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,095 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-08 22:54:32,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b40b37d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:32,098 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-08 22:54:32,098 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,099 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,099 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-08 22:54:32,099 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-08 22:54:32,099 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:32,099 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,100 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:32,100 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-08 22:54:32,100 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,101 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:32,101 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-08 22:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:32,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-08 22:54:32,104 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-08 22:54:32,104 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:32,104 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:32,105 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-08 22:54:32,105 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:32,106 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,106 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,106 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:32,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:32,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:32,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,108 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,110 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:32,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,122 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:32,122 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:32,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-08 22:54:32,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:32,122 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:32,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:32,122 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:32,122 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:32,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:32,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:32,123 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:32,223 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:32,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:32,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:32,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699484072242 (current time:1699484072242). 2023-11-08 22:54:32,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-08 22:54:32,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] zookeeper.ReadOnlyZKClient(139): Connect 0x6287c540 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:32,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3869a55e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:32,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:32,256 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41622, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:32,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6287c540 to 127.0.0.1:56299 2023-11-08 22:54:32,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:32,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-08 22:54:32,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:32,269 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot, current working dir path: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/snaptb-1699484072226 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-08 22:54:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:32,276 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:32,277 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699484672277 2023-11-08 22:54:32,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:32,277 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1699484072226 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-08 22:54:32,278 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:32,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-08 22:54:32,279 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-11-08 22:54:32,280 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-08 22:54:32,280 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1699484672280 2023-11-08 22:54:32,282 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:32,282 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-08 22:54:32,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1699484072226 2023-11-08 22:54:32,286 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1699484072226' 2023-11-08 22:54:32,287 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-08 22:54:32,287 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1699484072226' starting 'acquire' 2023-11-08 22:54:32,287 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1699484072226', kicking off acquire phase on members. 2023-11-08 22:54:32,287 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,287 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1699484072226 2023-11-08 22:54:32,288 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-08 22:54:32,288 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-08 22:54:32,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-08 22:54:32,288 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,288 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:32,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1699484072226 2023-11-08 22:54:32,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-08 22:54:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1699484072226 2023-11-08 22:54:32,289 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1699484072226 from table testCompactionWithHFileLink type FLUSH 2023-11-08 22:54:32,291 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1699484072226 2023-11-08 22:54:32,291 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1699484072226' with timeout 300000ms 2023-11-08 22:54:32,291 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-08 22:54:32,291 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1699484072226' starting 'acquire' stage 2023-11-08 22:54:32,291 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1699484072226' locally acquired 2023-11-08 22:54:32,291 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (snaptb-1699484072226) in zk 2023-11-08 22:54:32,292 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,292 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-08 22:54:32,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,293 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1699484072226' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'snaptb-1699484072226' on coordinator 2023-11-08 22:54:32,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@420cf18e[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:32,294 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1699484072226' starting 'in-barrier' execution. 2023-11-08 22:54:32,294 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,295 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,295 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1699484072226' received 'reached' from coordinator. 2023-11-08 22:54:32,295 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,295 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:32,296 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:32,296 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:32,296 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:32,297 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.' region-info for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,297 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.' region-info for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,297 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.' region-info for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,301 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-08 22:54:32,301 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-08 22:54:32,301 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44] hfiles 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06] hfiles 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d] hfiles 2023-11-08 22:54:32,304 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,307 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9] hfiles 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592] hfiles 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5] hfiles 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,308 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5 for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,382 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:32,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:32,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:32,387 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-08 22:54:32,587 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:32,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:32,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:32,590 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-08 22:54:32,715 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. completed. 2023-11-08 22:54:32,715 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:32,716 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. completed. 2023-11-08 22:54:32,716 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. completed. 2023-11-08 22:54:32,716 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:32,716 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-08 22:54:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-08 22:54:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-08 22:54:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-08 22:54:32,717 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1699484072226' locally completed 2023-11-08 22:54:32,718 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1699484072226' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:32,721 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1699484072226' has notified controller of completion 2023-11-08 22:54:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-08 22:54:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:32,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1699484072226' completed. 2023-11-08 22:54:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1699484072226' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:32,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'snaptb-1699484072226', counting down latch. Waiting for 0 more 2023-11-08 22:54:32,728 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1699484072226' execution completed 2023-11-08 22:54:32,728 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:32,728 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:32,728 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1699484072226 2023-11-08 22:54:32,728 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1699484072226including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-08 22:54:32,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:32,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-08 22:54:32,738 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-08 22:54:32,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-08 22:54:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-08 22:54:32,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:32,739 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:32,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,743 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:32,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1699484072226 2023-11-08 22:54:32,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699484072226 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1699484072226 2023-11-08 22:54:32,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-08 22:54:32,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1699484072226 2023-11-08 22:54:32,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699484072226/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1699484072226 2023-11-08 22:54:32,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1699484072226 2023-11-08 22:54:32,747 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:32,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-08 22:54:32,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-08 22:54:32,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-08 22:54:32,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1699484072226 2023-11-08 22:54:32,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-08 22:54:32,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a] mob files 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 2023-11-08 22:54:32,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62] mob files 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28 2023-11-08 22:54:32,752 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62 2023-11-08 22:54:32,890 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:32,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:32,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:32,893 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-08 22:54:33,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1699484072226 2023-11-08 22:54:33,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/snaptb-1699484072226 2023-11-08 22:54:33,393 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:33,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:33,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:33,395 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-08 22:54:33,616 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/snaptb-1699484072226 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/snaptb-1699484072226 2023-11-08 22:54:33,617 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1699484072226 of table testCompactionWithHFileLink completed 2023-11-08 22:54:33,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/snaptb-1699484072226 2023-11-08 22:54:33,617 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/snaptb-1699484072226 2023-11-08 22:54:33,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1699484072226 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699484072277Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1699484073159 (+882 ms)Consolidate snapshot: snaptb-1699484072226 at 1699484073159Loading Region manifests for snaptb-1699484072226 at 1699484073160 (+1 ms)Writing data manifest for snaptb-1699484072226 at 1699484073169 (+9 ms)Verifying snapshot: snaptb-1699484072226 at 1699484073577 (+408 ms)Snapshot snaptb-1699484072226 of table testCompactionWithHFileLink completed at 1699484073617 (+40 ms) 2023-11-08 22:54:33,620 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-08 22:54:33,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3420 sec 2023-11-08 22:54:34,395 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:34,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:34,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-08 22:54:34,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:34,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-08 22:54:34,486 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-08 22:54:34,486 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:34,486 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-08 22:54:34,487 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-08 22:54:34,488 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:34,488 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:34,489 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:34,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:34,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:34,490 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:34,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:34,491 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:34,491 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:34,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:34,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:34,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:34,493 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-08 22:54:34,494 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-08 22:54:34,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-08 22:54:34,494 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-08 22:54:34,494 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:34,494 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-08 22:54:34,498 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:34,498 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. started... 2023-11-08 22:54:34,499 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 983a597d793791ee6df1a90889470f48 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:34,502 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:34,502 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. started... 2023-11-08 22:54:34,503 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing aca9d12b860f784b19c77bdc5584176b 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:34,514 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:34,514 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:34,522 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:34,522 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. started... 2023-11-08 22:54:34,522 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing c22d0a51147f42a58be2b892dac41b50 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:34,603 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/233058b4f75045ceb31d690bb39754f9 2023-11-08 22:54:34,612 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 233058b4f75045ceb31d690bb39754f9 2023-11-08 22:54:34,622 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/2ed7299b123c4b1ebb389c8060e92fc5 2023-11-08 22:54:34,631 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/5aa26d086cf245718e4e8b1f0ef77276 2023-11-08 22:54:34,643 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed7299b123c4b1ebb389c8060e92fc5 2023-11-08 22:54:34,653 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aa26d086cf245718e4e8b1f0ef77276 2023-11-08 22:54:35,091 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/8b598602fe5f472baca4c9c57a7f250b 2023-11-08 22:54:35,095 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b598602fe5f472baca4c9c57a7f250b 2023-11-08 22:54:35,096 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/233058b4f75045ceb31d690bb39754f9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9 2023-11-08 22:54:35,104 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 233058b4f75045ceb31d690bb39754f9 2023-11-08 22:54:35,104 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9, entries=3, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,105 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/8b598602fe5f472baca4c9c57a7f250b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b 2023-11-08 22:54:35,110 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b598602fe5f472baca4c9c57a7f250b 2023-11-08 22:54:35,111 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b, entries=1, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,114 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 983a597d793791ee6df1a90889470f48 in 616ms, sequenceid=24, compaction requested=true 2023-11-08 22:54:35,115 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:35,115 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:35,115 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:35,115 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/b6f60dabb3834e80b6890ef8ab3d4861 2023-11-08 22:54:35,120 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6f60dabb3834e80b6890ef8ab3d4861 2023-11-08 22:54:35,120 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/2ed7299b123c4b1ebb389c8060e92fc5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5 2023-11-08 22:54:35,125 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ed7299b123c4b1ebb389c8060e92fc5 2023-11-08 22:54:35,125 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5, entries=3, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,125 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/b6f60dabb3834e80b6890ef8ab3d4861 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861 2023-11-08 22:54:35,132 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b6f60dabb3834e80b6890ef8ab3d4861 2023-11-08 22:54:35,132 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861, entries=1, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,133 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for c22d0a51147f42a58be2b892dac41b50 in 611ms, sequenceid=24, compaction requested=true 2023-11-08 22:54:35,133 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:35,133 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:35,133 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:35,517 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/329dfd0de5ae4e8c85fedecb40093ccd 2023-11-08 22:54:35,521 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 329dfd0de5ae4e8c85fedecb40093ccd 2023-11-08 22:54:35,522 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/5aa26d086cf245718e4e8b1f0ef77276 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276 2023-11-08 22:54:35,527 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aa26d086cf245718e4e8b1f0ef77276 2023-11-08 22:54:35,527 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276, entries=3, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,528 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/329dfd0de5ae4e8c85fedecb40093ccd as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd 2023-11-08 22:54:35,532 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 329dfd0de5ae4e8c85fedecb40093ccd 2023-11-08 22:54:35,532 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd, entries=1, sequenceid=24, filesize=5.0 K 2023-11-08 22:54:35,532 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for aca9d12b860f784b19c77bdc5584176b in 1029ms, sequenceid=24, compaction requested=true 2023-11-08 22:54:35,533 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:35,533 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:35,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:35,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:35,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-08 22:54:35,533 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-08 22:54:35,534 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,534 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:35,534 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:35,534 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-08 22:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a98d233[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:35,536 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-08 22:54:35,536 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,536 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,536 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-08 22:54:35,536 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-08 22:54:35,536 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:35,537 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,537 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:35,537 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-08 22:54:35,537 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:35,537 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,537 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:35,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:35,540 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-08 22:54:35,540 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-08 22:54:35,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:35,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:35,540 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-08 22:54:35,540 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:35,542 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,542 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,542 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:35,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:35,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:35,542 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:35,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,544 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-08 22:54:35,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,545 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:35,545 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:35,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-08 22:54:35,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:35,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:35,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-08 22:54:35,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:35,546 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:35,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:35,646 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:35,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:35,648 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:35,648 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 983a597d793791ee6df1a90889470f48/family1 is initiating major compaction (all files) 2023-11-08 22:54:35,648 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:35,648 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:35,649 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 983a597d793791ee6df1a90889470f48/family1 in testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:35,649 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp, totalSize=26.7 K 2023-11-08 22:54:35,650 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 44ae5eef19084d1b91b3f44870e91ec8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:35,650 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 313f16f14de148eca08690ccccc59491, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:35,651 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 6f8a8699741b4ff188292c966e6b85c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:35,651 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting eeeb316e93b444c0bb7db84e13878b44, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070392 2023-11-08 22:54:35,652 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 233058b4f75045ceb31d690bb39754f9, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:35,663 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 983a597d793791ee6df1a90889470f48#family1#compaction#106 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:36,080 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del 2023-11-08 22:54:36,080 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del 2023-11-08 22:54:36,504 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ae43d13374345c6a2563755d6734113 2023-11-08 22:54:36,504 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/2ae43d13374345c6a2563755d6734113 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/2ae43d13374345c6a2563755d6734113 2023-11-08 22:54:36,507 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2ae43d13374345c6a2563755d6734113 2023-11-08 22:54:36,508 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 983a597d793791ee6df1a90889470f48/family1 of 983a597d793791ee6df1a90889470f48 into 2ae43d13374345c6a2563755d6734113(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:36,508 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:36,508 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:36,508 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 983a597d793791ee6df1a90889470f48/family2 is initiating major compaction (all files) 2023-11-08 22:54:36,508 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:36,509 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:36,509 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 983a597d793791ee6df1a90889470f48/family2 in testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:36,509 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp, totalSize=25.4 K 2023-11-08 22:54:36,509 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a309f4118e874dd988ffefcad65d3fd4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:36,509 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 37e6498cdac34d09a50f11e312a0e9c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:36,510 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 4a4fb91b675446b98a2c66bc4e6ded21, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:36,510 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 93dffcb5ccea45159224b96d7de7b592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070392 2023-11-08 22:54:36,510 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 8b598602fe5f472baca4c9c57a7f250b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:36,525 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 983a597d793791ee6df1a90889470f48#family2#compaction#107 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:36,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9] to archive 2023-11-08 22:54:36,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:36,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/44ae5eef19084d1b91b3f44870e91ec8 2023-11-08 22:54:36,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/313f16f14de148eca08690ccccc59491 2023-11-08 22:54:36,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/6f8a8699741b4ff188292c966e6b85c2 2023-11-08 22:54:36,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/eeeb316e93b444c0bb7db84e13878b44 2023-11-08 22:54:36,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/233058b4f75045ceb31d690bb39754f9 2023-11-08 22:54:36,942 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del 2023-11-08 22:54:36,943 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del 2023-11-08 22:54:37,772 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 740eeb032e904c8995e89d409b19709d 2023-11-08 22:54:37,773 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/740eeb032e904c8995e89d409b19709d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/740eeb032e904c8995e89d409b19709d 2023-11-08 22:54:37,779 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 740eeb032e904c8995e89d409b19709d 2023-11-08 22:54:37,781 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 983a597d793791ee6df1a90889470f48/family2 of 983a597d793791ee6df1a90889470f48 into 740eeb032e904c8995e89d409b19709d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:37,781 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:37,781 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:37,781 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): aca9d12b860f784b19c77bdc5584176b/family1 is initiating major compaction (all files) 2023-11-08 22:54:37,781 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:37,781 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:37,781 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of aca9d12b860f784b19c77bdc5584176b/family1 in testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:37,782 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp, totalSize=26.7 K 2023-11-08 22:54:37,782 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting cc48a293aedf407faf9b77c83ffbd95a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064907 2023-11-08 22:54:37,783 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting d706dc4f799e4540951cb0e512bb30c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066725 2023-11-08 22:54:37,783 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 4b5853ca2fa644f0b2122cea28ce7140, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068542 2023-11-08 22:54:37,784 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 9718e5be30714088bec009f2be878e2d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070391 2023-11-08 22:54:37,784 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5aa26d086cf245718e4e8b1f0ef77276, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:37,789 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b] to archive 2023-11-08 22:54:37,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:37,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/a309f4118e874dd988ffefcad65d3fd4 2023-11-08 22:54:37,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/37e6498cdac34d09a50f11e312a0e9c8 2023-11-08 22:54:37,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/4a4fb91b675446b98a2c66bc4e6ded21 2023-11-08 22:54:37,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/93dffcb5ccea45159224b96d7de7b592 2023-11-08 22:54:37,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/8b598602fe5f472baca4c9c57a7f250b 2023-11-08 22:54:37,801 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): aca9d12b860f784b19c77bdc5584176b#family1#compaction#108 average throughput is 0.43 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:38,219 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del 2023-11-08 22:54:38,220 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del 2023-11-08 22:54:39,055 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2f19aead9c642e69d82ce0431852eb3 2023-11-08 22:54:39,056 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/b2f19aead9c642e69d82ce0431852eb3 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/b2f19aead9c642e69d82ce0431852eb3 2023-11-08 22:54:39,060 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2f19aead9c642e69d82ce0431852eb3 2023-11-08 22:54:39,061 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aca9d12b860f784b19c77bdc5584176b/family1 of aca9d12b860f784b19c77bdc5584176b into b2f19aead9c642e69d82ce0431852eb3(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:39,061 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:39,061 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:39,062 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): aca9d12b860f784b19c77bdc5584176b/family2 is initiating major compaction (all files) 2023-11-08 22:54:39,062 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:39,062 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:39,062 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of aca9d12b860f784b19c77bdc5584176b/family2 in testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:39,062 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp, totalSize=25.4 K 2023-11-08 22:54:39,062 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting fe57dc7787d0443abe8a28b3ba59b3df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064907 2023-11-08 22:54:39,063 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f08f0ce24b734528b522b9df40e43a0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066725 2023-11-08 22:54:39,063 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting e457ff627c534b64a0c16b07555292b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068542 2023-11-08 22:54:39,064 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 624ec3cf35f64001a251bd316b8f8ce5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070391 2023-11-08 22:54:39,064 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 329dfd0de5ae4e8c85fedecb40093ccd, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:39,078 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): aca9d12b860f784b19c77bdc5584176b#family2#compaction#109 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:39,090 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276] to archive 2023-11-08 22:54:39,091 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:39,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/cc48a293aedf407faf9b77c83ffbd95a 2023-11-08 22:54:39,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/d706dc4f799e4540951cb0e512bb30c5 2023-11-08 22:54:39,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/4b5853ca2fa644f0b2122cea28ce7140 2023-11-08 22:54:39,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/9718e5be30714088bec009f2be878e2d 2023-11-08 22:54:39,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5aa26d086cf245718e4e8b1f0ef77276 2023-11-08 22:54:39,493 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del 2023-11-08 22:54:39,493 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del 2023-11-08 22:54:40,313 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 048c4bf557944bdfa0a1a541fc4ea546 2023-11-08 22:54:40,314 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/048c4bf557944bdfa0a1a541fc4ea546 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/048c4bf557944bdfa0a1a541fc4ea546 2023-11-08 22:54:40,317 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 048c4bf557944bdfa0a1a541fc4ea546 2023-11-08 22:54:40,318 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in aca9d12b860f784b19c77bdc5584176b/family2 of aca9d12b860f784b19c77bdc5584176b into 048c4bf557944bdfa0a1a541fc4ea546(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:40,318 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:40,318 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:40,318 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): c22d0a51147f42a58be2b892dac41b50/family1 is initiating major compaction (all files) 2023-11-08 22:54:40,318 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:40,318 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:40,319 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of c22d0a51147f42a58be2b892dac41b50/family1 in testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:40,319 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp, totalSize=26.7 K 2023-11-08 22:54:40,320 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5030afd22c944a9ebd79fc1b62c46fba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:40,320 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 689a4e0ec8744beba52e7e492e6675e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:40,320 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting ab6aa215087d4ab2b53999225e1bd842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:40,321 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting c548a780c85740a189651dca9c331e06, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070393 2023-11-08 22:54:40,321 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 2ed7299b123c4b1ebb389c8060e92fc5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:40,332 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): c22d0a51147f42a58be2b892dac41b50#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:40,389 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd] to archive 2023-11-08 22:54:40,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:40,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/fe57dc7787d0443abe8a28b3ba59b3df 2023-11-08 22:54:40,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/f08f0ce24b734528b522b9df40e43a0e 2023-11-08 22:54:40,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/e457ff627c534b64a0c16b07555292b6 2023-11-08 22:54:40,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/624ec3cf35f64001a251bd316b8f8ce5 2023-11-08 22:54:40,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/329dfd0de5ae4e8c85fedecb40093ccd 2023-11-08 22:54:40,744 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del 2023-11-08 22:54:40,744 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del 2023-11-08 22:54:41,578 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b613cd0b17d4da3a490ca54a3b0bbc5 2023-11-08 22:54:41,580 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/7b613cd0b17d4da3a490ca54a3b0bbc5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/7b613cd0b17d4da3a490ca54a3b0bbc5 2023-11-08 22:54:41,587 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b613cd0b17d4da3a490ca54a3b0bbc5 2023-11-08 22:54:41,588 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c22d0a51147f42a58be2b892dac41b50/family1 of c22d0a51147f42a58be2b892dac41b50 into 7b613cd0b17d4da3a490ca54a3b0bbc5(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:41,588 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:41,588 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:41,589 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): c22d0a51147f42a58be2b892dac41b50/family2 is initiating major compaction (all files) 2023-11-08 22:54:41,589 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:41,589 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:41,589 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of c22d0a51147f42a58be2b892dac41b50/family2 in testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:41,589 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp, totalSize=25.4 K 2023-11-08 22:54:41,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5] to archive 2023-11-08 22:54:41,590 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 06dd9b8ac42d418eb39d281d6abc7368, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:41,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:41,590 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f9d9d48625ce4108a3ff8bffae42637a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:41,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 6ed2e1ed7f184aa0b93ea24fb7c8a5db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:41,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 0fd932fd9eed42f1ad3da5ffe676e2b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070393 2023-11-08 22:54:41,592 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting b6f60dabb3834e80b6890ef8ab3d4861, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-08 22:54:41,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/5030afd22c944a9ebd79fc1b62c46fba 2023-11-08 22:54:41,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/689a4e0ec8744beba52e7e492e6675e8 2023-11-08 22:54:41,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/ab6aa215087d4ab2b53999225e1bd842 2023-11-08 22:54:41,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/c548a780c85740a189651dca9c331e06 2023-11-08 22:54:41,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/2ed7299b123c4b1ebb389c8060e92fc5 2023-11-08 22:54:41,608 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): c22d0a51147f42a58be2b892dac41b50#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:42,026 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del 2023-11-08 22:54:42,026 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del 2023-11-08 22:54:42,862 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 342cd09f07fa41c1acaa07b72d93e150 2023-11-08 22:54:42,863 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/342cd09f07fa41c1acaa07b72d93e150 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/342cd09f07fa41c1acaa07b72d93e150 2023-11-08 22:54:42,867 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 342cd09f07fa41c1acaa07b72d93e150 2023-11-08 22:54:42,868 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in c22d0a51147f42a58be2b892dac41b50/family2 of c22d0a51147f42a58be2b892dac41b50 into 342cd09f07fa41c1acaa07b72d93e150(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:42,868 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:42,874 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:42,879 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:42,885 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:42,886 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:42,891 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:54:42,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861] to archive 2023-11-08 22:54:42,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:42,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/06dd9b8ac42d418eb39d281d6abc7368 2023-11-08 22:54:42,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/f9d9d48625ce4108a3ff8bffae42637a 2023-11-08 22:54:42,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/6ed2e1ed7f184aa0b93ea24fb7c8a5db 2023-11-08 22:54:42,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/0fd932fd9eed42f1ad3da5ffe676e2b9 2023-11-08 22:54:42,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/b6f60dabb3834e80b6890ef8ab3d4861 2023-11-08 22:54:42,926 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-08 22:54:42,929 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del 2023-11-08 22:54:42,932 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del 2023-11-08 22:54:42,936 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del 2023-11-08 22:54:42,936 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:42,938 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(139): Connect 0x78bf798f to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:42,942 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7b89a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:42,943 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:42,943 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:42,943 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:43,399 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2 2023-11-08 22:54:43,400 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,412 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:43,415 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:43,423 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:54:43,425 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:54:43,434 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/ddf79f980750422595ee1145f2f841ca first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-08 22:54:43,435 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/ddf79f980750422595ee1145f2f841ca}] 2023-11-08 22:54:43,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/ddf79f980750422595ee1145f2f841ca for inclusion in c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:43,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-08 22:54:43,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-08 22:54:43,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:43,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/ddf79f980750422595ee1145f2f841ca to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__hg61mifa2gi700divmub712ospejll4pfobvriofb77ptep0bstac9nk24vrh2pd/family1/ddf79f980750422595ee1145f2f841ca 2023-11-08 22:54:43,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__hg61mifa2gi700divmub712ospejll4pfobvriofb77ptep0bstac9nk24vrh2pd/family1/ddf79f980750422595ee1145f2f841ca as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ 2023-11-08 22:54:43,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__hg61mifa2gi700divmub712ospejll4pfobvriofb77ptep0bstac9nk24vrh2pd/family1/ddf79f980750422595ee1145f2f841ca into c22d0a51147f42a58be2b892dac41b50/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ - updating store file list. 2023-11-08 22:54:43,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ into c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:43,454 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__hg61mifa2gi700divmub712ospejll4pfobvriofb77ptep0bstac9nk24vrh2pd/family1/ddf79f980750422595ee1145f2f841ca into c22d0a51147f42a58be2b892dac41b50/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_) 2023-11-08 22:54:43,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__hg61mifa2gi700divmub712ospejll4pfobvriofb77ptep0bstac9nk24vrh2pd/family1/ddf79f980750422595ee1145f2f841ca 2023-11-08 22:54:43,457 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,458 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,461 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 2023-11-08 22:54:43,463 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 2023-11-08 22:54:43,464 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa 2023-11-08 22:54:43,466 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b 2023-11-08 22:54:43,467 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:43,467 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108' 2023-11-08 22:54:43,467 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:43,806 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a 2023-11-08 22:54:43,807 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f 2023-11-08 22:54:43,808 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,808 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,838 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/56b01b88d3714289874af5a31c6e9c98 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-08 22:54:43,838 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/04a364c99bae4111ad8bc3052923cda1 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-08 22:54:43,840 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/56b01b88d3714289874af5a31c6e9c98}] 2023-11-08 22:54:43,840 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/04a364c99bae4111ad8bc3052923cda1}] 2023-11-08 22:54:43,842 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/56b01b88d3714289874af5a31c6e9c98 for inclusion in 983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:43,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/04a364c99bae4111ad8bc3052923cda1 for inclusion in aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:43,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-08 22:54:43,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-08 22:54:43,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-08 22:54:43,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last=1 2023-11-08 22:54:43,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:43,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:43,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/56b01b88d3714289874af5a31c6e9c98 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__7v3sti4nuaaupd8o69fifbh7qn3u47prfh60dblgo8uuhv6hijgac91089rj64hi/family1/56b01b88d3714289874af5a31c6e9c98 2023-11-08 22:54:43,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/04a364c99bae4111ad8bc3052923cda1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__er78guv2mekt5rb7gteslq78fi5psb4fecm4fik2idsc6bt5232rb9130pb7cmhm/family1/04a364c99bae4111ad8bc3052923cda1 2023-11-08 22:54:43,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__7v3sti4nuaaupd8o69fifbh7qn3u47prfh60dblgo8uuhv6hijgac91089rj64hi/family1/56b01b88d3714289874af5a31c6e9c98 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ 2023-11-08 22:54:43,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__er78guv2mekt5rb7gteslq78fi5psb4fecm4fik2idsc6bt5232rb9130pb7cmhm/family1/04a364c99bae4111ad8bc3052923cda1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ 2023-11-08 22:54:43,849 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__7v3sti4nuaaupd8o69fifbh7qn3u47prfh60dblgo8uuhv6hijgac91089rj64hi/family1/56b01b88d3714289874af5a31c6e9c98 into 983a597d793791ee6df1a90889470f48/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ - updating store file list. 2023-11-08 22:54:43,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__er78guv2mekt5rb7gteslq78fi5psb4fecm4fik2idsc6bt5232rb9130pb7cmhm/family1/04a364c99bae4111ad8bc3052923cda1 into aca9d12b860f784b19c77bdc5584176b/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ - updating store file list. 2023-11-08 22:54:43,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ into 983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:43,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ into aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:43,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__7v3sti4nuaaupd8o69fifbh7qn3u47prfh60dblgo8uuhv6hijgac91089rj64hi/family1/56b01b88d3714289874af5a31c6e9c98 into 983a597d793791ee6df1a90889470f48/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_) 2023-11-08 22:54:43,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__er78guv2mekt5rb7gteslq78fi5psb4fecm4fik2idsc6bt5232rb9130pb7cmhm/family1/04a364c99bae4111ad8bc3052923cda1 into aca9d12b860f784b19c77bdc5584176b/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_) 2023-11-08 22:54:43,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__7v3sti4nuaaupd8o69fifbh7qn3u47prfh60dblgo8uuhv6hijgac91089rj64hi/family1/56b01b88d3714289874af5a31c6e9c98 2023-11-08 22:54:43,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__er78guv2mekt5rb7gteslq78fi5psb4fecm4fik2idsc6bt5232rb9130pb7cmhm/family1/04a364c99bae4111ad8bc3052923cda1 2023-11-08 22:54:43,854 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,854 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,854 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,854 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,856 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 2023-11-08 22:54:43,856 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 2023-11-08 22:54:43,857 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab 2023-11-08 22:54:43,857 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f 2023-11-08 22:54:43,857 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 2023-11-08 22:54:43,858 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 2023-11-08 22:54:43,858 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece 2023-11-08 22:54:43,858 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:43,858 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a 2023-11-08 22:54:43,858 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108' 2023-11-08 22:54:43,858 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:43,858 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108' 2023-11-08 22:54:43,859 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:43,859 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:43,859 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:43,859 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:43,859 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del] 2023-11-08 22:54:43,859 DEBUG [Listener at localhost/37975] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,860 DEBUG [Listener at localhost/37975] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023110891e7454cb3f54355bebfa36b3d9b1838_del 2023-11-08 22:54:43,860 INFO [Listener at localhost/37975] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-08 22:54:43,860 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del] 2023-11-08 22:54:43,861 DEBUG [Listener at localhost/37975] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,862 DEBUG [Listener at localhost/37975] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231108e4069a35fb064fb1933a7e07753baf78_del 2023-11-08 22:54:43,862 INFO [Listener at localhost/37975] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-08 22:54:43,862 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del] 2023-11-08 22:54:43,862 DEBUG [Listener at localhost/37975] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:43,863 DEBUG [Listener at localhost/37975] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110838380eda6d5e40ef8b801ff2219a2a1e_del 2023-11-08 22:54:43,863 INFO [Listener at localhost/37975] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-08 22:54:43,866 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:43,868 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:43,872 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:43,873 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:43,878 INFO [Listener at localhost/37975] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-08 22:54:43,879 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-11-08 22:54:43,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-08 22:54:43,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-08 22:54:43,882 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484083882"}]},"ts":"1699484083882"} 2023-11-08 22:54:43,883 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-08 22:54:43,884 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-08 22:54:43,885 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, UNASSIGN}] 2023-11-08 22:54:43,887 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, UNASSIGN 2023-11-08 22:54:43,887 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, UNASSIGN 2023-11-08 22:54:43,887 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, UNASSIGN 2023-11-08 22:54:43,887 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:43,887 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:43,887 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:43,888 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484083887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484083887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484083887"}]},"ts":"1699484083887"} 2023-11-08 22:54:43,888 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484083887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484083887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484083887"}]},"ts":"1699484083887"} 2023-11-08 22:54:43,888 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484083887"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484083887"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484083887"}]},"ts":"1699484083887"} 2023-11-08 22:54:43,889 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:43,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:43,890 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:43,947 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase20.apache.org,35543,1699483966133, timeout=1699484084040, delay=93, operations=[pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133, pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133, pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133]] 2023-11-08 22:54:43,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-08 22:54:44,040 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:44,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:44,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 983a597d793791ee6df1a90889470f48, disabling compactions & flushes 2023-11-08 22:54:44,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:44,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:44,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. after waiting 0 ms 2023-11-08 22:54:44,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:44,046 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-08 22:54:44,048 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:44,048 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:44,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:44,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:44,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aca9d12b860f784b19c77bdc5584176b, disabling compactions & flushes 2023-11-08 22:54:44,050 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:44,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:44,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. after waiting 0 ms 2023-11-08 22:54:44,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:44,051 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=CLOSED 2023-11-08 22:54:44,051 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484084051"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484084051"}]},"ts":"1699484084051"} 2023-11-08 22:54:44,055 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-11-08 22:54:44,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133 in 164 msec 2023-11-08 22:54:44,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-08 22:54:44,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, UNASSIGN in 171 msec 2023-11-08 22:54:44,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:44,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:44,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:44,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:44,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c22d0a51147f42a58be2b892dac41b50, disabling compactions & flushes 2023-11-08 22:54:44,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:44,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:44,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. after waiting 0 ms 2023-11-08 22:54:44,061 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=CLOSED 2023-11-08 22:54:44,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:44,061 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484084061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484084061"}]},"ts":"1699484084061"} 2023-11-08 22:54:44,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-11-08 22:54:44,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 174 msec 2023-11-08 22:54:44,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, UNASSIGN in 179 msec 2023-11-08 22:54:44,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-08 22:54:44,067 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:44,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:44,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:44,068 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=CLOSED 2023-11-08 22:54:44,068 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484084068"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484084068"}]},"ts":"1699484084068"} 2023-11-08 22:54:44,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-11-08 22:54:44,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133 in 179 msec 2023-11-08 22:54:44,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=88 2023-11-08 22:54:44,071 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, UNASSIGN in 185 msec 2023-11-08 22:54:44,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484084072"}]},"ts":"1699484084072"} 2023-11-08 22:54:44,073 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-08 22:54:44,074 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-08 22:54:44,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 196 msec 2023-11-08 22:54:44,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-08 22:54:44,184 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-08 22:54:44,199 INFO [Listener at localhost/37975] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:44,200 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:44,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1699484084200 (current time:1699484084200). 2023-11-08 22:54:44,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-08 22:54:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] zookeeper.ReadOnlyZKClient(139): Connect 0x07283d7d to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:44,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2072533c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:44,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:44,209 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:44,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07283d7d to 127.0.0.1:56299 2023-11-08 22:54:44,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:44,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-08 22:54:44,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:44,213 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot, current working dir path: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699484072226-1699484084199 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-08 22:54:44,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:44,216 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:44,216 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1699484684216 2023-11-08 22:54:44,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:44,217 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1699484072226-1699484084199 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-08 22:54:44,217 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:44,217 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-08 22:54:44,317 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:44,320 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-08 22:54:44,520 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:44,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:44,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:44,521 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-08 22:54:44,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-08 22:54:44,629 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-08 22:54:44,629 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-08 22:54:44,629 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-08 22:54:44,629 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-08 22:54:44,629 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-08 22:54:44,630 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-08 22:54:44,630 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-08 22:54:44,630 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/b2f19aead9c642e69d82ce0431852eb3] hfiles 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/2ae43d13374345c6a2563755d6734113] hfiles 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/7b613cd0b17d4da3a490ca54a3b0bbc5] hfiles 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a] hfiles 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/2ae43d13374345c6a2563755d6734113 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/b2f19aead9c642e69d82ce0431852eb3 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/7b613cd0b17d4da3a490ca54a3b0bbc5 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2 2023-11-08 22:54:44,635 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/048c4bf557944bdfa0a1a541fc4ea546] hfiles 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/740eeb032e904c8995e89d409b19709d] hfiles 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/342cd09f07fa41c1acaa07b72d93e150] hfiles 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/048c4bf557944bdfa0a1a541fc4ea546 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/342cd09f07fa41c1acaa07b72d93e150 2023-11-08 22:54:44,636 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/740eeb032e904c8995e89d409b19709d 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62] hfiles 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023110809139ae891914f148b27160cc7cc1747 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311083f7f4587d1964ac18c8e25cb17b82b58 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108c54b44d97e184974a7eb147b6046581a 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc9ef3211a8e4ed2a1d260d3d7b33f87 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202311086ac2e4b758db46f7a390b5930360fe03 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108973418af879a4e08a1db7a2cbbfdf921 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108985587bb0c244cf5b768587ed7761b3e 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231108d7fdac184eed4bb4ad83fcdc3721eb0b 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110858ebd9ae230c420e92fca8ea9d9253e3 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023110887fb594c33c143489dcd860f7289ca9a 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311089a9e1f14e6c5466796bfa78f3dce5c28 2023-11-08 22:54:44,641 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231108da333515d8df44518ef8cc7f3e74dd62 2023-11-08 22:54:44,821 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:44,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:44,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:44,824 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-08 22:54:45,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-08 22:54:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:45,324 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:45,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:45,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-08 22:54:45,327 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-08 22:54:45,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699484072226-1699484084199 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:45,481 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1699484072226-1699484084199 of table testCompactionWithHFileLink completed 2023-11-08 22:54:45,481 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:45,481 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:45,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1699484072226-1699484084199 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1699484084217Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1699484084627 (+410 ms)Consolidate snapshot: hbase-failsafe-snaptb-1699484072226-1699484084199 at 1699484085046 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1699484072226-1699484084199 at 1699484085046Writing data manifest for hbase-failsafe-snaptb-1699484072226-1699484084199 at 1699484085050 (+4 ms)Verifying snapshot: hbase-failsafe-snaptb-1699484072226-1699484084199 at 1699484085462 (+412 ms)Snapshot hbase-failsafe-snaptb-1699484072226-1699484084199 of table testCompactionWithHFileLink completed at 1699484085481 (+19 ms) 2023-11-08 22:54:45,482 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-08 22:54:45,484 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2680 sec 2023-11-08 22:54:46,328 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-08 22:54:46,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-08 22:54:46,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1699484072226-1699484084199 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-08 22:54:46,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699484072226" table: "testCompactionWithHFileLink" creation_time: 1699484072242 type: FLUSH version: 2 ttl: 0 ) 2023-11-08 22:54:46,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1699484072226 as table=testCompactionWithHFileLink 2023-11-08 22:54:46,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-08 22:54:46,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-08 22:54:46,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-08 22:54:46,779 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-08 22:54:46,781 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:46,781 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-08 22:54:46,783 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-08 22:54:46,790 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1699484072226" table: "testCompactionWithHFileLink" creation_time: 1699484072242 type: FLUSH version: 2 ttl: 0 2023-11-08 22:54:46,791 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink 2023-11-08 22:54:46,798 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-08 22:54:46,801 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311080f42ac34c51249268f48a03948bb530f 2023-11-08 22:54:46,803 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108bca75587297b4e01bee8596ff768251a 2023-11-08 22:54:46,804 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231108f4cfae215bc9409bbf8f0f39b48cc2c2 2023-11-08 22:54:46,804 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,808 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,811 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,814 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,817 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,820 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,824 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,827 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,831 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,835 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,839 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,842 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a of snapshot=snaptb-1699484072226 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-08 22:54:46,850 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023110863ff4aa9b7934d34827df5539a5e47d1_del 2023-11-08 22:54:46,851 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311081101dfde1914403286a5b59d5cc54ad9_del 2023-11-08 22:54:46,853 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231108f51bd25b1d6745f0b9fd6ae216ee1e44_del 2023-11-08 22:54:46,854 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:46,854 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:46,854 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:46,858 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/1b4f3a32043a4ffda2df6912c47bd3b3_SeqId_29_ 2023-11-08 22:54:46,858 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/6dc523a5ba054f2b849b4b264a227f0c_SeqId_29_ 2023-11-08 22:54:46,859 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/5d00abfd59ae41c5812cb552b1b59e0f_SeqId_29_ 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/2ae43d13374345c6a2563755d6734113 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/2ae43d13374345c6a2563755d6734113 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 44ae5eef19084d1b91b3f44870e91ec8 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/7b613cd0b17d4da3a490ca54a3b0bbc5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/7b613cd0b17d4da3a490ca54a3b0bbc5 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5030afd22c944a9ebd79fc1b62c46fba of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/b2f19aead9c642e69d82ce0431852eb3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/b2f19aead9c642e69d82ce0431852eb3 2023-11-08 22:54:46,860 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cc48a293aedf407faf9b77c83ffbd95a of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,863 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 313f16f14de148eca08690ccccc59491 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,863 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d706dc4f799e4540951cb0e512bb30c5 of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,863 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 689a4e0ec8744beba52e7e492e6675e8 of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,866 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6f8a8699741b4ff188292c966e6b85c2 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,866 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4b5853ca2fa644f0b2122cea28ce7140 of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,866 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ab6aa215087d4ab2b53999225e1bd842 of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,871 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9718e5be30714088bec009f2be878e2d of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,872 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eeeb316e93b444c0bb7db84e13878b44 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,872 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c548a780c85740a189651dca9c331e06 of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,884 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/740eeb032e904c8995e89d409b19709d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/740eeb032e904c8995e89d409b19709d 2023-11-08 22:54:46,884 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a309f4118e874dd988ffefcad65d3fd4 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,887 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/342cd09f07fa41c1acaa07b72d93e150 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/342cd09f07fa41c1acaa07b72d93e150 2023-11-08 22:54:46,888 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 37e6498cdac34d09a50f11e312a0e9c8 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,887 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/048c4bf557944bdfa0a1a541fc4ea546 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/048c4bf557944bdfa0a1a541fc4ea546 2023-11-08 22:54:46,888 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 06dd9b8ac42d418eb39d281d6abc7368 of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,888 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fe57dc7787d0443abe8a28b3ba59b3df of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,898 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4a4fb91b675446b98a2c66bc4e6ded21 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,899 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f08f0ce24b734528b522b9df40e43a0e of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,899 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f9d9d48625ce4108a3ff8bffae42637a of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,903 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e457ff627c534b64a0c16b07555292b6 of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,903 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 93dffcb5ccea45159224b96d7de7b592 of snapshot=snaptb-1699484072226 to region=983a597d793791ee6df1a90889470f48 table=testCompactionWithHFileLink 2023-11-08 22:54:46,903 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ed2e1ed7f184aa0b93ea24fb7c8a5db of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,907 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 624ec3cf35f64001a251bd316b8f8ce5 of snapshot=snaptb-1699484072226 to region=aca9d12b860f784b19c77bdc5584176b table=testCompactionWithHFileLink 2023-11-08 22:54:46,907 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0fd932fd9eed42f1ad3da5ffe676e2b9 of snapshot=snaptb-1699484072226 to region=c22d0a51147f42a58be2b892dac41b50 table=testCompactionWithHFileLink 2023-11-08 22:54:46,910 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1699484072226" table: "testCompactionWithHFileLink" creation_time: 1699484072242 type: FLUSH version: 2 ttl: 0 2023-11-08 22:54:46,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699484086911"}]},"ts":"9223372036854775807"} 2023-11-08 22:54:46,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699484086911"}]},"ts":"9223372036854775807"} 2023-11-08 22:54:46,911 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1699484086911"}]},"ts":"9223372036854775807"} 2023-11-08 22:54:46,913 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-08 22:54:46,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 983a597d793791ee6df1a90889470f48, NAME => 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => aca9d12b860f784b19c77bdc5584176b, NAME => 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c22d0a51147f42a58be2b892dac41b50, NAME => 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.', STARTKEY => '2', ENDKEY => ''}] 2023-11-08 22:54:46,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484086912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484086912"}]},"ts":"1699484086912"} 2023-11-08 22:54:46,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484086912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484086912"}]},"ts":"1699484086912"} 2023-11-08 22:54:46,913 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484086912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484086912"}]},"ts":"1699484086912"} 2023-11-08 22:54:46,915 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-08 22:54:46,915 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-08 22:54:46,915 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 983a597d793791ee6df1a90889470f48, NAME => 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => aca9d12b860f784b19c77bdc5584176b, NAME => 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c22d0a51147f42a58be2b892dac41b50, NAME => 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.', STARTKEY => '2', ENDKEY => ''}] 2023-11-08 22:54:46,915 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1699484072226 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-08 22:54:46,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1699484072226" table: "testCompactionWithHFileLink" creation_time: 1699484072242 type: FLUSH version: 2 ttl: 0 ) in 559 msec 2023-11-08 22:54:46,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-08 22:54:46,975 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-08 22:54:46,975 INFO [Listener at localhost/37975] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:46,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1699484072226-1699484084199" 2023-11-08 22:54:46,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1699484072226-1699484084199 2023-11-08 22:54:46,983 INFO [Listener at localhost/37975] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-08 22:54:46,986 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-11-08 22:54:46,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-08 22:54:46,993 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-08 22:54:46,994 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484086993"}]},"ts":"1699484086993"} 2023-11-08 22:54:46,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-08 22:54:46,994 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-08 22:54:46,996 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-08 22:54:46,997 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN}] 2023-11-08 22:54:46,998 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN 2023-11-08 22:54:46,998 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN 2023-11-08 22:54:46,998 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN 2023-11-08 22:54:46,999 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-08 22:54:46,999 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-08 22:54:46,999 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-08 22:54:47,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-08 22:54:47,150 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,150 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,150 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484087150"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484087150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484087150"}]},"ts":"1699484087150"} 2023-11-08 22:54:47,150 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484087150"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484087150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484087150"}]},"ts":"1699484087150"} 2023-11-08 22:54:47,150 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484087150"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484087150"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484087150"}]},"ts":"1699484087150"} 2023-11-08 22:54:47,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:47,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:47,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:47,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-08 22:54:47,303 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,306 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:47,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aca9d12b860f784b19c77bdc5584176b, NAME => 'testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.', STARTKEY => '', ENDKEY => '1'} 2023-11-08 22:54:47,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:47,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,308 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,309 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:47,309 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:47,309 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca9d12b860f784b19c77bdc5584176b columnFamilyName family1 2023-11-08 22:54:47,319 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140 2023-11-08 22:54:47,325 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d 2023-11-08 22:54:47,331 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a 2023-11-08 22:54:47,336 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5 2023-11-08 22:54:47,337 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(310): Store=aca9d12b860f784b19c77bdc5584176b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,337 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,338 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2 2023-11-08 22:54:47,338 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2 2023-11-08 22:54:47,338 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aca9d12b860f784b19c77bdc5584176b columnFamilyName family2 2023-11-08 22:54:47,346 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5 2023-11-08 22:54:47,351 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6 2023-11-08 22:54:47,356 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e 2023-11-08 22:54:47,362 DEBUG [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df 2023-11-08 22:54:47,362 INFO [StoreOpener-aca9d12b860f784b19c77bdc5584176b-1] regionserver.HStore(310): Store=aca9d12b860f784b19c77bdc5584176b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:47,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:54:47,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened aca9d12b860f784b19c77bdc5584176b; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67875152, jitterRate=0.011418581008911133}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:47,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:47,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., pid=103, masterSystemTime=1699484087303 2023-11-08 22:54:47,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-08 22:54:47,370 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-08 22:54:47,370 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-08 22:54:47,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:47,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:47,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 983a597d793791ee6df1a90889470f48, NAME => 'testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.', STARTKEY => '1', ENDKEY => '2'} 2023-11-08 22:54:47,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=aca9d12b860f784b19c77bdc5584176b, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484087372"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484087372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484087372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484087372"}]},"ts":"1699484087372"} 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,373 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-08 22:54:47,373 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-08 22:54:47,374 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1912): aca9d12b860f784b19c77bdc5584176b/family1 is initiating minor compaction (all files) 2023-11-08 22:54:47,374 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1912): aca9d12b860f784b19c77bdc5584176b/family2 is initiating minor compaction (all files) 2023-11-08 22:54:47,374 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of aca9d12b860f784b19c77bdc5584176b/family1 in testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:47,374 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2259): Starting compaction of aca9d12b860f784b19c77bdc5584176b/family2 in testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:54:47,374 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp, totalSize=21.6 K 2023-11-08 22:54:47,374 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp, totalSize=20.4 K 2023-11-08 22:54:47,374 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=98 2023-11-08 22:54:47,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure aca9d12b860f784b19c77bdc5584176b, server=jenkins-hbase20.apache.org,35543,1699483966133 in 221 msec 2023-11-08 22:54:47,377 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064907 2023-11-08 22:54:47,377 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064907 2023-11-08 22:54:47,377 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:47,377 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:47,377 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=aca9d12b860f784b19c77bdc5584176b, ASSIGN in 378 msec 2023-11-08 22:54:47,377 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 983a597d793791ee6df1a90889470f48 columnFamilyName family1 2023-11-08 22:54:47,377 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066725 2023-11-08 22:54:47,378 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066725 2023-11-08 22:54:47,378 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068542 2023-11-08 22:54:47,378 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068542 2023-11-08 22:54:47,379 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070391 2023-11-08 22:54:47,379 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070391 2023-11-08 22:54:47,391 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491 2023-11-08 22:54:47,407 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8 2023-11-08 22:54:47,412 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): aca9d12b860f784b19c77bdc5584176b#family1#compaction#112 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:47,413 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] throttle.PressureAwareThroughputController(145): aca9d12b860f784b19c77bdc5584176b#family2#compaction#113 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:47,416 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2 2023-11-08 22:54:47,427 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44 2023-11-08 22:54:47,427 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(310): Store=983a597d793791ee6df1a90889470f48/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,427 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,428 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2 2023-11-08 22:54:47,428 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2 2023-11-08 22:54:47,428 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 983a597d793791ee6df1a90889470f48 columnFamilyName family2 2023-11-08 22:54:47,434 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8 2023-11-08 22:54:47,438 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21 2023-11-08 22:54:47,443 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592 2023-11-08 22:54:47,448 DEBUG [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4 2023-11-08 22:54:47,448 INFO [StoreOpener-983a597d793791ee6df1a90889470f48-1] regionserver.HStore(310): Store=983a597d793791ee6df1a90889470f48/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,450 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,452 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:47,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 983a597d793791ee6df1a90889470f48 2023-11-08 22:54:47,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 983a597d793791ee6df1a90889470f48; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70398660, jitterRate=0.049021780490875244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:47,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:47,455 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., pid=102, masterSystemTime=1699484087303 2023-11-08 22:54:47,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-08 22:54:47,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-08 22:54:47,456 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:47,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:47,456 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:47,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c22d0a51147f42a58be2b892dac41b50, NAME => 'testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.', STARTKEY => '2', ENDKEY => ''} 2023-11-08 22:54:47,457 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=983a597d793791ee6df1a90889470f48, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,457 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484087457"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484087457"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484087457"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484087457"}]},"ts":"1699484087457"} 2023-11-08 22:54:47,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:47,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,457 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,459 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,459 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=99 2023-11-08 22:54:47,460 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:47,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 983a597d793791ee6df1a90889470f48, server=jenkins-hbase20.apache.org,35543,1699483966133 in 305 msec 2023-11-08 22:54:47,460 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:47,460 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c22d0a51147f42a58be2b892dac41b50 columnFamilyName family1 2023-11-08 22:54:47,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=983a597d793791ee6df1a90889470f48, ASSIGN in 463 msec 2023-11-08 22:54:47,467 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba 2023-11-08 22:54:47,473 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8 2023-11-08 22:54:47,480 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842 2023-11-08 22:54:47,486 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06 2023-11-08 22:54:47,486 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(310): Store=c22d0a51147f42a58be2b892dac41b50/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,487 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,487 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2 2023-11-08 22:54:47,487 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2 2023-11-08 22:54:47,488 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c22d0a51147f42a58be2b892dac41b50 columnFamilyName family2 2023-11-08 22:54:47,496 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368 2023-11-08 22:54:47,502 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9 2023-11-08 22:54:47,508 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db 2023-11-08 22:54:47,515 DEBUG [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(539): loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a 2023-11-08 22:54:47,515 INFO [StoreOpener-c22d0a51147f42a58be2b892dac41b50-1] regionserver.HStore(310): Store=c22d0a51147f42a58be2b892dac41b50/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:47,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:47,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:54:47,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c22d0a51147f42a58be2b892dac41b50; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60887803, jitterRate=-0.0927010327577591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:47,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:47,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., pid=101, masterSystemTime=1699484087303 2023-11-08 22:54:47,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-08 22:54:47,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-08 22:54:47,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:47,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:47,522 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c22d0a51147f42a58be2b892dac41b50, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:47,522 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1699484087522"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484087522"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484087522"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484087522"}]},"ts":"1699484087522"} 2023-11-08 22:54:47,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-11-08 22:54:47,524 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure c22d0a51147f42a58be2b892dac41b50, server=jenkins-hbase20.apache.org,35543,1699483966133 in 371 msec 2023-11-08 22:54:47,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=100, resume processing ppid=97 2023-11-08 22:54:47,525 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=c22d0a51147f42a58be2b892dac41b50, ASSIGN in 527 msec 2023-11-08 22:54:47,526 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484087526"}]},"ts":"1699484087526"} 2023-11-08 22:54:47,527 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-08 22:54:47,528 INFO [PEWorker-2] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-08 22:54:47,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 541 msec 2023-11-08 22:54:47,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-08 22:54:47,597 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-08 22:54:47,613 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:47,623 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:47,632 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:47,632 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:47,638 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:54:47,653 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-08 22:54:47,653 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:47,654 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(139): Connect 0x36ed467e to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:54:47,658 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e857be4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:54:47,659 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:47,659 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:47,659 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:48,171 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110870027b4ce6d74207a91b1fc39bb43ba0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023110870027b4ce6d74207a91b1fc39bb43ba0 2023-11-08 22:54:48,171 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108e94b259196954fe1905c04ff2da9d3d7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231108e94b259196954fe1905c04ff2da9d3d7 2023-11-08 22:54:48,172 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,172 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,173 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311085702c7cdecce4bf28be14fb0d3424984 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311085702c7cdecce4bf28be14fb0d3424984 2023-11-08 22:54:48,174 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,184 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:54:48,189 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:34146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:54:48,196 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:54:48,199 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:54:48,218 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/eb4f2ca228da468a811cd4589123d578 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-08 22:54:48,219 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=32 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/eb4f2ca228da468a811cd4589123d578}] 2023-11-08 22:54:48,219 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/091b97ba9a264900b26c480f8e0ca5e0 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-08 22:54:48,220 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/091b97ba9a264900b26c480f8e0ca5e0}] 2023-11-08 22:54:48,222 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/845059232f6047bbb37873e9e21cc2ee first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-08 22:54:48,224 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/845059232f6047bbb37873e9e21cc2ee}] 2023-11-08 22:54:48,230 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/eb4f2ca228da468a811cd4589123d578 for inclusion in aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:48,231 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/091b97ba9a264900b26c480f8e0ca5e0 for inclusion in c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:48,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/845059232f6047bbb37873e9e21cc2ee for inclusion in 983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-08 22:54:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last=1 2023-11-08 22:54:48,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:48,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-08 22:54:48,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-08 22:54:48,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:48,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108/family1/eb4f2ca228da468a811cd4589123d578 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__fjgegnnv78s5kn7p0gfac7i7kjhvbflsb0trduq4d8ec5uv6uugcnr440jmef8lc/family1/eb4f2ca228da468a811cd4589123d578 2023-11-08 22:54:48,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-08 22:54:48,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-08 22:54:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:48,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108/family1/845059232f6047bbb37873e9e21cc2ee to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__naaretq6p8jnebcg0bt5t74ajsqmsocr9kk0dtce6b2d5hi8l6f044uit3bqia2i/family1/845059232f6047bbb37873e9e21cc2ee 2023-11-08 22:54:48,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108/family1/091b97ba9a264900b26c480f8e0ca5e0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__ph4i85e9p4mg29ffps4oq2dn5h49fotgqrc8gp5dcuulldasi1hflmvrk7jd2a1u/family1/091b97ba9a264900b26c480f8e0ca5e0 2023-11-08 22:54:48,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__fjgegnnv78s5kn7p0gfac7i7kjhvbflsb0trduq4d8ec5uv6uugcnr440jmef8lc/family1/eb4f2ca228da468a811cd4589123d578 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/a380f09a7aec49779d89d21a4fa4f0bf_SeqId_34_ 2023-11-08 22:54:48,239 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__fjgegnnv78s5kn7p0gfac7i7kjhvbflsb0trduq4d8ec5uv6uugcnr440jmef8lc/family1/eb4f2ca228da468a811cd4589123d578 into aca9d12b860f784b19c77bdc5584176b/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/a380f09a7aec49779d89d21a4fa4f0bf_SeqId_34_ - updating store file list. 2023-11-08 22:54:48,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__naaretq6p8jnebcg0bt5t74ajsqmsocr9kk0dtce6b2d5hi8l6f044uit3bqia2i/family1/845059232f6047bbb37873e9e21cc2ee as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_ 2023-11-08 22:54:48,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__ph4i85e9p4mg29ffps4oq2dn5h49fotgqrc8gp5dcuulldasi1hflmvrk7jd2a1u/family1/091b97ba9a264900b26c480f8e0ca5e0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_ 2023-11-08 22:54:48,241 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__ph4i85e9p4mg29ffps4oq2dn5h49fotgqrc8gp5dcuulldasi1hflmvrk7jd2a1u/family1/091b97ba9a264900b26c480f8e0ca5e0 into c22d0a51147f42a58be2b892dac41b50/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_ - updating store file list. 2023-11-08 22:54:48,241 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__naaretq6p8jnebcg0bt5t74ajsqmsocr9kk0dtce6b2d5hi8l6f044uit3bqia2i/family1/845059232f6047bbb37873e9e21cc2ee into 983a597d793791ee6df1a90889470f48/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_ - updating store file list. 2023-11-08 22:54:48,242 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family2/56984e78dfdb4d099e9290799a7f24d9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/56984e78dfdb4d099e9290799a7f24d9 2023-11-08 22:54:48,244 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/a380f09a7aec49779d89d21a4fa4f0bf_SeqId_34_ into aca9d12b860f784b19c77bdc5584176b/family1 2023-11-08 22:54:48,244 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__fjgegnnv78s5kn7p0gfac7i7kjhvbflsb0trduq4d8ec5uv6uugcnr440jmef8lc/family1/eb4f2ca228da468a811cd4589123d578 into aca9d12b860f784b19c77bdc5584176b/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/a380f09a7aec49779d89d21a4fa4f0bf_SeqId_34_) 2023-11-08 22:54:48,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__fjgegnnv78s5kn7p0gfac7i7kjhvbflsb0trduq4d8ec5uv6uugcnr440jmef8lc/family1/eb4f2ca228da468a811cd4589123d578 2023-11-08 22:54:48,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_ into c22d0a51147f42a58be2b892dac41b50/family1 2023-11-08 22:54:48,245 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__ph4i85e9p4mg29ffps4oq2dn5h49fotgqrc8gp5dcuulldasi1hflmvrk7jd2a1u/family1/091b97ba9a264900b26c480f8e0ca5e0 into c22d0a51147f42a58be2b892dac41b50/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_) 2023-11-08 22:54:48,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_ into 983a597d793791ee6df1a90889470f48/family1 2023-11-08 22:54:48,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__naaretq6p8jnebcg0bt5t74ajsqmsocr9kk0dtce6b2d5hi8l6f044uit3bqia2i/family1/845059232f6047bbb37873e9e21cc2ee into 983a597d793791ee6df1a90889470f48/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_) 2023-11-08 22:54:48,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__ph4i85e9p4mg29ffps4oq2dn5h49fotgqrc8gp5dcuulldasi1hflmvrk7jd2a1u/family1/091b97ba9a264900b26c480f8e0ca5e0 2023-11-08 22:54:48,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:48,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testCompactionWithHFileLink__naaretq6p8jnebcg0bt5t74ajsqmsocr9kk0dtce6b2d5hi8l6f044uit3bqia2i/family1/845059232f6047bbb37873e9e21cc2ee 2023-11-08 22:54:48,247 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,248 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-08 22:54:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(1912): c22d0a51147f42a58be2b892dac41b50/family1 is initiating minor compaction (all files) 2023-11-08 22:54:48,248 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in aca9d12b860f784b19c77bdc5584176b/family2 of aca9d12b860f784b19c77bdc5584176b into 56984e78dfdb4d099e9290799a7f24d9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@656b2d23; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-08 22:54:48,248 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:48,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:48,248 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., storeName=aca9d12b860f784b19c77bdc5584176b/family2, priority=12, startTime=1699484087370; duration=0sec 2023-11-08 22:54:48,249 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311080d6d09c01a924dc59cda5cbb528eae26 2023-11-08 22:54:48,250 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,250 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231108209156cfe58c44a498908d40299a501f 2023-11-08 22:54:48,251 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:48,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-08 22:54:48,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 983a597d793791ee6df1a90889470f48/family1 is initiating minor compaction (all files) 2023-11-08 22:54:48,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@74639d7c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-08 22:54:48,251 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-08 22:54:48,251 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c22d0a51147f42a58be2b892dac41b50/family1 in testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:48,251 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp, totalSize=28.9 K 2023-11-08 22:54:48,252 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108806fab88553547d4aa2a3e002ba062c7 2023-11-08 22:54:48,252 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:48,253 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023110820977af647c343c78c8885598c485077 2023-11-08 22:54:48,253 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:48,253 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108887c0d8032184ab59068c94cbaa85aa3 2023-11-08 22:54:48,253 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,254 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311085105405db2b549adb0c922ea74fc105a 2023-11-08 22:54:48,254 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:48,254 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231108' 2023-11-08 22:54:48,254 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:48,254 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:48,255 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:48,255 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202311088cff18e9e6e048cfbd89b3ef034712aa 2023-11-08 22:54:48,255 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070393 2023-11-08 22:54:48,256 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting 04ff7c89795340468eaacb44c1d714c7_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699484064908 2023-11-08 22:54:48,256 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b2023110821429175274f4316977937fa5a232384 2023-11-08 22:54:48,256 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231108e3f24a2b44994d13946f11699becaa4b 2023-11-08 22:54:48,256 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:48,257 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231108' 2023-11-08 22:54:48,257 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:48,257 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311083b650e1695fa4d5fac12f5e3fcc888ab 2023-11-08 22:54:48,258 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311084b5896efb47844878658d31e4950d577 2023-11-08 22:54:48,259 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202311084cbbe9ba0fed4139af862d0c4b5ffece 2023-11-08 22:54:48,259 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-08 22:54:48,259 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231108' 2023-11-08 22:54:48,259 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231108 for table='testCompactionWithHFileLink' and column='family1' 2023-11-08 22:54:48,260 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-08 22:54:48,265 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:48,268 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:48,272 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] throttle.PressureAwareThroughputController(145): c22d0a51147f42a58be2b892dac41b50#family1#compaction#114 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:48,272 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:48,274 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:48,280 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:48,281 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:48,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5] to archive 2023-11-08 22:54:48,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:48,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-fe57dc7787d0443abe8a28b3ba59b3df 2023-11-08 22:54:48,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-f08f0ce24b734528b522b9df40e43a0e 2023-11-08 22:54:48,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-e457ff627c534b64a0c16b07555292b6 2023-11-08 22:54:48,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family2/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-624ec3cf35f64001a251bd316b8f8ce5 2023-11-08 22:54:48,300 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=295 (was 236) - Thread LEAK? -, OpenFileDescriptor=801 (was 622) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=110 (was 147), ProcessCount=167 (was 167), AvailableMemoryMB=5871 (was 5921) 2023-11-08 22:54:48,313 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=292, OpenFileDescriptor=801, MaxFileDescriptor=60000, SystemLoadAverage=110, ProcessCount=167, AvailableMemoryMB=5870 2023-11-08 22:54:48,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-11-08 22:54:48,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-08 22:54:48,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-08 22:54:48,325 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-08 22:54:48,326 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 8 msec 2023-11-08 22:54:48,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-08 22:54:48,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-08 22:54:48,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-08 22:54:48,429 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:54:48,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-08 22:54:48,430 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:54:48,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:48,433 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70 2023-11-08 22:54:48,434 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:48,434 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:48,434 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70 empty. 2023-11-08 22:54:48,434 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5 empty. 2023-11-08 22:54:48,434 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f empty. 2023-11-08 22:54:48,435 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70 2023-11-08 22:54:48,435 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:48,435 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:48,435 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-08 22:54:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:48,579 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.15384615384615385, tune throughput to 57.69 MB/second 2023-11-08 22:54:48,638 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/.tmp/family1/28c1d9927de2467c9992338912bd22bf as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/28c1d9927de2467c9992338912bd22bf 2023-11-08 22:54:48,643 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in aca9d12b860f784b19c77bdc5584176b/family1 of aca9d12b860f784b19c77bdc5584176b into 28c1d9927de2467c9992338912bd22bf(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:48,643 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:54:48,643 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b., storeName=aca9d12b860f784b19c77bdc5584176b/family1, priority=12, startTime=1699484087369; duration=1sec 2023-11-08 22:54:48,643 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-08 22:54:48,643 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 983a597d793791ee6df1a90889470f48/family1 in testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:48,643 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp, totalSize=28.9 K 2023-11-08 22:54:48,644 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:48,645 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:48,645 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:48,646 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070392 2023-11-08 22:54:48,646 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 59caff709c2a4afd995bb69f7dc0885d_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1699484064908 2023-11-08 22:54:48,658 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 983a597d793791ee6df1a90889470f48#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-08 22:54:48,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d] to archive 2023-11-08 22:54:48,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:48,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-cc48a293aedf407faf9b77c83ffbd95a 2023-11-08 22:54:48,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-d706dc4f799e4540951cb0e512bb30c5 2023-11-08 22:54:48,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-4b5853ca2fa644f0b2122cea28ce7140 2023-11-08 22:54:48,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/family1/testCompactionWithHFileLink=aca9d12b860f784b19c77bdc5584176b-9718e5be30714088bec009f2be878e2d 2023-11-08 22:54:48,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:48,851 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-08 22:54:48,854 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => de49c86467f227f556743d409603dd70, NAME => 'ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:48,855 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7390e98da36ed002cdd3df703123f9e5, NAME => 'ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:48,855 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 1c95e8c8a1ca454a69d5f71fe09e2f2f, NAME => 'ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:54:49,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing de49c86467f227f556743d409603dd70, disabling compactions & flushes 2023-11-08 22:54:49,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. after waiting 0 ms 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 1c95e8c8a1ca454a69d5f71fe09e2f2f, disabling compactions & flushes 2023-11-08 22:54:49,265 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. after waiting 0 ms 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:49,265 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 7390e98da36ed002cdd3df703123f9e5, disabling compactions & flushes 2023-11-08 22:54:49,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. after waiting 0 ms 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,266 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,266 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:49,268 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:54:49,268 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484089268"}]},"ts":"1699484089268"} 2023-11-08 22:54:49,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484089268"}]},"ts":"1699484089268"} 2023-11-08 22:54:49,269 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699484089268"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484089268"}]},"ts":"1699484089268"} 2023-11-08 22:54:49,270 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-08 22:54:49,271 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:54:49,271 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484089271"}]},"ts":"1699484089271"} 2023-11-08 22:54:49,272 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-08 22:54:49,275 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=de49c86467f227f556743d409603dd70, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7390e98da36ed002cdd3df703123f9e5, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1c95e8c8a1ca454a69d5f71fe09e2f2f, ASSIGN}] 2023-11-08 22:54:49,276 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1c95e8c8a1ca454a69d5f71fe09e2f2f, ASSIGN 2023-11-08 22:54:49,276 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=de49c86467f227f556743d409603dd70, ASSIGN 2023-11-08 22:54:49,276 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7390e98da36ed002cdd3df703123f9e5, ASSIGN 2023-11-08 22:54:49,277 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=de49c86467f227f556743d409603dd70, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:49,277 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1c95e8c8a1ca454a69d5f71fe09e2f2f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:49,277 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7390e98da36ed002cdd3df703123f9e5, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:54:49,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=de49c86467f227f556743d409603dd70, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,430 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7390e98da36ed002cdd3df703123f9e5, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,430 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1c95e8c8a1ca454a69d5f71fe09e2f2f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,430 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699484089430"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484089430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484089430"}]},"ts":"1699484089430"} 2023-11-08 22:54:49,430 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089430"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484089430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484089430"}]},"ts":"1699484089430"} 2023-11-08 22:54:49,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089430"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484089430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484089430"}]},"ts":"1699484089430"} 2023-11-08 22:54:49,432 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 7390e98da36ed002cdd3df703123f9e5, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:49,432 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 1c95e8c8a1ca454a69d5f71fe09e2f2f, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:49,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure de49c86467f227f556743d409603dd70, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:54:49,483 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family1/959211f6666b4c06b42dfacc3b726a77 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/959211f6666b4c06b42dfacc3b726a77 2023-11-08 22:54:49,491 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 983a597d793791ee6df1a90889470f48/family1 of 983a597d793791ee6df1a90889470f48 into 959211f6666b4c06b42dfacc3b726a77(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:49,492 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:49,492 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699484088251; duration=0sec 2023-11-08 22:54:49,492 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-08 22:54:49,492 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-08 22:54:49,496 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-08 22:54:49,496 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1912): 983a597d793791ee6df1a90889470f48/family2 is initiating minor compaction (all files) 2023-11-08 22:54:49,496 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 983a597d793791ee6df1a90889470f48/family2 in testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:54:49,496 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp, totalSize=20.4 K 2023-11-08 22:54:49,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_] to archive 2023-11-08 22:54:49,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:49,498 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:49,498 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:49,499 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:49,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-44ae5eef19084d1b91b3f44870e91ec8 2023-11-08 22:54:49,500 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070392 2023-11-08 22:54:49,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-313f16f14de148eca08690ccccc59491 2023-11-08 22:54:49,502 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family1/d0e8d4030b3e46c4bf2b7899e621d5b3 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/d0e8d4030b3e46c4bf2b7899e621d5b3 2023-11-08 22:54:49,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-6f8a8699741b4ff188292c966e6b85c2 2023-11-08 22:54:49,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-eeeb316e93b444c0bb7db84e13878b44 2023-11-08 22:54:49,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family1/59caff709c2a4afd995bb69f7dc0885d_SeqId_34_ 2023-11-08 22:54:49,508 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in c22d0a51147f42a58be2b892dac41b50/family1 of c22d0a51147f42a58be2b892dac41b50 into d0e8d4030b3e46c4bf2b7899e621d5b3(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:49,508 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:49,508 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1699484088248; duration=1sec 2023-11-08 22:54:49,508 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-08 22:54:49,509 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-08 22:54:49,511 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-08 22:54:49,511 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1912): c22d0a51147f42a58be2b892dac41b50/family2 is initiating minor compaction (all files) 2023-11-08 22:54:49,511 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c22d0a51147f42a58be2b892dac41b50/family2 in testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:54:49,511 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp, totalSize=20.4 K 2023-11-08 22:54:49,512 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484064908 2023-11-08 22:54:49,512 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484066726 2023-11-08 22:54:49,513 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484068543 2023-11-08 22:54:49,513 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484070393 2023-11-08 22:54:49,514 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 983a597d793791ee6df1a90889470f48#family2#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-08 22:54:49,528 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] throttle.PressureAwareThroughputController(145): c22d0a51147f42a58be2b892dac41b50#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-08 22:54:49,531 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/.tmp/family2/2491af992b144fc389d880f1001d4251 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/2491af992b144fc389d880f1001d4251 2023-11-08 22:54:49,536 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 983a597d793791ee6df1a90889470f48/family2 of 983a597d793791ee6df1a90889470f48 into 2491af992b144fc389d880f1001d4251(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:49,536 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:54:49,536 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48., storeName=983a597d793791ee6df1a90889470f48/family2, priority=12, startTime=1699484087455; duration=0sec 2023-11-08 22:54:49,536 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-08 22:54:49,536 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-08 22:54:49,536 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. because compaction request was cancelled 2023-11-08 22:54:49,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-08 22:54:49,537 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. because compaction request was cancelled 2023-11-08 22:54:49,584 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,586 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1c95e8c8a1ca454a69d5f71fe09e2f2f, NAME => 'ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.', STARTKEY => '2', ENDKEY => ''} 2023-11-08 22:54:49,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,588 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592] to archive 2023-11-08 22:54:49,589 DEBUG [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 2023-11-08 22:54:49,589 DEBUG [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 2023-11-08 22:54:49,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:49,589 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:54:49,590 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c95e8c8a1ca454a69d5f71fe09e2f2f columnFamilyName family1 2023-11-08 22:54:49,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-a309f4118e874dd988ffefcad65d3fd4 2023-11-08 22:54:49,591 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] regionserver.HStore(310): Store=1c95e8c8a1ca454a69d5f71fe09e2f2f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,591 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-37e6498cdac34d09a50f11e312a0e9c8 2023-11-08 22:54:49,597 DEBUG [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2 2023-11-08 22:54:49,597 DEBUG [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2 2023-11-08 22:54:49,597 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1c95e8c8a1ca454a69d5f71fe09e2f2f columnFamilyName family2 2023-11-08 22:54:49,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-4a4fb91b675446b98a2c66bc4e6ded21 2023-11-08 22:54:49,599 INFO [StoreOpener-1c95e8c8a1ca454a69d5f71fe09e2f2f-1] regionserver.HStore(310): Store=1c95e8c8a1ca454a69d5f71fe09e2f2f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/family2/testCompactionWithHFileLink=983a597d793791ee6df1a90889470f48-93dffcb5ccea45159224b96d7de7b592 2023-11-08 22:54:49,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_] to archive 2023-11-08 22:54:49,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:49,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:49,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-5030afd22c944a9ebd79fc1b62c46fba 2023-11-08 22:54:49,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:54:49,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-689a4e0ec8744beba52e7e492e6675e8 2023-11-08 22:54:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:49,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1c95e8c8a1ca454a69d5f71fe09e2f2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67881056, jitterRate=0.01150655746459961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:49,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:49,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-ab6aa215087d4ab2b53999225e1bd842 2023-11-08 22:54:49,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f., pid=110, masterSystemTime=1699484089584 2023-11-08 22:54:49,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-c548a780c85740a189651dca9c331e06 2023-11-08 22:54:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:49,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => de49c86467f227f556743d409603dd70, NAME => 'ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.', STARTKEY => '', ENDKEY => '1'} 2023-11-08 22:54:49,606 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=1c95e8c8a1ca454a69d5f71fe09e2f2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,606 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089606"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484089606"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484089606"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484089606"}]},"ts":"1699484089606"} 2023-11-08 22:54:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family1/04ff7c89795340468eaacb44c1d714c7_SeqId_34_ 2023-11-08 22:54:49,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,607 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,608 DEBUG [StoreOpener-de49c86467f227f556743d409603dd70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1 2023-11-08 22:54:49,608 DEBUG [StoreOpener-de49c86467f227f556743d409603dd70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1 2023-11-08 22:54:49,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-11-08 22:54:49,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 1c95e8c8a1ca454a69d5f71fe09e2f2f, server=jenkins-hbase20.apache.org,35543,1699483966133 in 175 msec 2023-11-08 22:54:49,609 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de49c86467f227f556743d409603dd70 columnFamilyName family1 2023-11-08 22:54:49,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=1c95e8c8a1ca454a69d5f71fe09e2f2f, ASSIGN in 333 msec 2023-11-08 22:54:49,609 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] regionserver.HStore(310): Store=de49c86467f227f556743d409603dd70/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,610 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,611 DEBUG [StoreOpener-de49c86467f227f556743d409603dd70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2 2023-11-08 22:54:49,611 DEBUG [StoreOpener-de49c86467f227f556743d409603dd70-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2 2023-11-08 22:54:49,611 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region de49c86467f227f556743d409603dd70 columnFamilyName family2 2023-11-08 22:54:49,612 INFO [StoreOpener-de49c86467f227f556743d409603dd70-1] regionserver.HStore(310): Store=de49c86467f227f556743d409603dd70/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:49,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for de49c86467f227f556743d409603dd70 2023-11-08 22:54:49,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:49,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened de49c86467f227f556743d409603dd70; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73656227, jitterRate=0.09756331145763397}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:49,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:49,618 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70., pid=111, masterSystemTime=1699484089584 2023-11-08 22:54:49,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:49,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=de49c86467f227f556743d409603dd70, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7390e98da36ed002cdd3df703123f9e5, NAME => 'ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.', STARTKEY => '1', ENDKEY => '2'} 2023-11-08 22:54:49,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1699484089619"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484089619"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484089619"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484089619"}]},"ts":"1699484089619"} 2023-11-08 22:54:49,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:54:49,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,621 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=106 2023-11-08 22:54:49,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure de49c86467f227f556743d409603dd70, server=jenkins-hbase20.apache.org,35543,1699483966133 in 187 msec 2023-11-08 22:54:49,622 DEBUG [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1 2023-11-08 22:54:49,623 DEBUG [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1 2023-11-08 22:54:49,634 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7390e98da36ed002cdd3df703123f9e5 columnFamilyName family1 2023-11-08 22:54:49,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=de49c86467f227f556743d409603dd70, ASSIGN in 347 msec 2023-11-08 22:54:49,639 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:49,639 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36ed467e to 127.0.0.1:56299 2023-11-08 22:54:49,639 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:49,639 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] regionserver.HStore(310): Store=7390e98da36ed002cdd3df703123f9e5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,642 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:49,642 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78bf798f to 127.0.0.1:56299 2023-11-08 22:54:49,642 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:49,642 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,642 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:54:49,642 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x484d4d22 to 127.0.0.1:56299 2023-11-08 22:54:49,642 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:54:49,648 DEBUG [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2 2023-11-08 22:54:49,648 DEBUG [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2 2023-11-08 22:54:49,648 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7390e98da36ed002cdd3df703123f9e5 columnFamilyName family2 2023-11-08 22:54:49,649 INFO [StoreOpener-7390e98da36ed002cdd3df703123f9e5-1] regionserver.HStore(310): Store=7390e98da36ed002cdd3df703123f9e5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:54:49,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:54:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:54:49,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7390e98da36ed002cdd3df703123f9e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65747542, jitterRate=-0.02028527855873108}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:54:49,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:49,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5., pid=109, masterSystemTime=1699484089584 2023-11-08 22:54:49,655 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:49,656 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7390e98da36ed002cdd3df703123f9e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:49,656 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1699484089656"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484089656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484089656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484089656"}]},"ts":"1699484089656"} 2023-11-08 22:54:49,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-11-08 22:54:49,658 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 7390e98da36ed002cdd3df703123f9e5, server=jenkins-hbase20.apache.org,35543,1699483966133 in 225 msec 2023-11-08 22:54:49,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-11-08 22:54:49,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7390e98da36ed002cdd3df703123f9e5, ASSIGN in 383 msec 2023-11-08 22:54:49,660 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:54:49,660 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484089660"}]},"ts":"1699484089660"} 2023-11-08 22:54:49,661 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-08 22:54:49,662 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:54:49,663 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2360 sec 2023-11-08 22:54:49,706 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-08 22:54:50,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-08 22:54:50,539 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-08 22:54:50,549 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:50,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:50,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:50,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:50,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-08 22:54:50,556 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-08 22:54:50,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:50,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-08 22:54:50,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-08 22:54:50,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:50,556 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:50,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:50,558 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:50,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:50,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:50,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:50,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:50,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:50,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:50,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:50,559 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-08 22:54:50,559 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-08 22:54:50,560 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-08 22:54:50,560 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:50,560 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-08 22:54:50,560 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:50,560 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:50,560 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. started... 2023-11-08 22:54:50,560 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. started... 2023-11-08 22:54:50,561 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:50,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7390e98da36ed002cdd3df703123f9e5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:50,563 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:50,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing de49c86467f227f556743d409603dd70 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:50,563 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:50,563 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. started... 2023-11-08 22:54:50,563 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1c95e8c8a1ca454a69d5f71fe09e2f2f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:54:50,572 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311081a42c2d082e7497caa551431551d99e0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311081a42c2d082e7497caa551431551d99e0 2023-11-08 22:54:50,757 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/.tmp/family2/c320e2ddcada4d55a9b951bc5d001950 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/c320e2ddcada4d55a9b951bc5d001950 2023-11-08 22:54:50,764 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in c22d0a51147f42a58be2b892dac41b50/family2 of c22d0a51147f42a58be2b892dac41b50 into c320e2ddcada4d55a9b951bc5d001950(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:54:50,764 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:54:50,764 INFO [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50., storeName=c22d0a51147f42a58be2b892dac41b50/family2, priority=12, startTime=1699484087520; duration=1sec 2023-11-08 22:54:50,764 DEBUG [RS:0;jenkins-hbase20:35543-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:54:50,790 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9] to archive 2023-11-08 22:54:50,791 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:50,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-06dd9b8ac42d418eb39d281d6abc7368 2023-11-08 22:54:50,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-f9d9d48625ce4108a3ff8bffae42637a 2023-11-08 22:54:50,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-6ed2e1ed7f184aa0b93ea24fb7c8a5db 2023-11-08 22:54:50,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/family2/testCompactionWithHFileLink=c22d0a51147f42a58be2b892dac41b50-0fd932fd9eed42f1ad3da5ffe676e2b9 2023-11-08 22:54:50,977 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/a71fecb3728e47859d8b21f3b1912e50 2023-11-08 22:54:50,978 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311080c9fa8ec598649dc9b5482bef60e59d7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311080c9fa8ec598649dc9b5482bef60e59d7 2023-11-08 22:54:50,978 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108785808a4787f4a5f8f4e93206346be37 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108785808a4787f4a5f8f4e93206346be37 2023-11-08 22:54:50,984 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/3dee89b0942a4f279f7231132f9229fd 2023-11-08 22:54:51,384 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/cf042504b79c4120af2b0c1369a483f0 2023-11-08 22:54:51,394 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311086381de460d5649ee9df53ec5d7d18449 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311086381de460d5649ee9df53ec5d7d18449 2023-11-08 22:54:51,402 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108f829c17527834ae58a0b056436d08eb2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231108f829c17527834ae58a0b056436d08eb2 2023-11-08 22:54:51,801 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/43665e48f98b40c5a03025569064bb4e 2023-11-08 22:54:51,803 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108d4892a3e32a748fd87a53493757d823d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231108d4892a3e32a748fd87a53493757d823d 2023-11-08 22:54:51,808 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/a71fecb3728e47859d8b21f3b1912e50 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50 2023-11-08 22:54:51,808 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/c815f757b36b45b3af8d46f7fad6f3b2 2023-11-08 22:54:51,812 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:51,813 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/3dee89b0942a4f279f7231132f9229fd as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd 2023-11-08 22:54:51,813 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/43665e48f98b40c5a03025569064bb4e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e 2023-11-08 22:54:51,818 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:51,819 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/c815f757b36b45b3af8d46f7fad6f3b2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2 2023-11-08 22:54:51,819 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:51,823 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:51,827 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7390e98da36ed002cdd3df703123f9e5 in 1264ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:51,827 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 1c95e8c8a1ca454a69d5f71fe09e2f2f in 1264ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:51,827 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:51,828 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:51,828 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:51,828 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:51,828 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:51,828 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:52,219 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/5f83fbdb963a46a792f39b401d8c6967 2023-11-08 22:54:52,225 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/cf042504b79c4120af2b0c1369a483f0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0 2023-11-08 22:54:52,229 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0, entries=4, sequenceid=5, filesize=5.4 K 2023-11-08 22:54:52,230 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/5f83fbdb963a46a792f39b401d8c6967 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967 2023-11-08 22:54:52,237 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:54:52,238 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for de49c86467f227f556743d409603dd70 in 1675ms, sequenceid=5, compaction requested=false 2023-11-08 22:54:52,238 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:52,238 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:52,238 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:52,238 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:52,238 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,238 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-08 22:54:52,238 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-08 22:54:52,242 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,242 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:52,243 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:52,243 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:52,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:52,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-08 22:54:52,244 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@86cff4d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:52,244 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-08 22:54:52,244 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,245 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-08 22:54:52,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-08 22:54:52,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:52,245 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,245 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:52,246 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-08 22:54:52,246 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:52,246 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-08 22:54:52,246 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:52,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:52,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-08 22:54:52,249 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-08 22:54:52,249 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:52,249 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:52,249 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-08 22:54:52,249 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:52,251 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,251 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:52,251 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:52,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,253 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:52,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,254 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:52,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:52,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:52,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:52,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:52,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-08 22:54:52,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:52,256 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:52,256 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,257 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:52,257 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:52,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:52,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:52,357 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:52,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:52,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:52,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:52,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:52,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-08 22:54:52,363 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-08 22:54:52,364 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:52,364 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-08 22:54:52,364 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-08 22:54:52,364 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,364 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:52,365 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:52,365 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:52,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:52,365 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:52,365 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:52,366 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:52,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:52,367 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-08 22:54:52,369 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-08 22:54:52,369 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-08 22:54:52,369 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-08 22:54:52,369 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:52,369 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-08 22:54:52,377 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:52,377 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. started... 2023-11-08 22:54:52,377 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing de49c86467f227f556743d409603dd70 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:52,382 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:52,383 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. started... 2023-11-08 22:54:52,383 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7390e98da36ed002cdd3df703123f9e5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:52,390 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:52,392 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:52,392 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. started... 2023-11-08 22:54:52,392 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1c95e8c8a1ca454a69d5f71fe09e2f2f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:54:52,470 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311089b9a82586a5d471694b013775034fc4f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311089b9a82586a5d471694b013775034fc4f 2023-11-08 22:54:52,841 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108484ce88de3904388bd4508105ca3c5f2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231108484ce88de3904388bd4508105ca3c5f2 2023-11-08 22:54:52,863 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/bdd764ab4f4f4de38970ee063cdcb11f 2023-11-08 22:54:52,866 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108a6ff210fb2474229b875647920ee817c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108a6ff210fb2474229b875647920ee817c 2023-11-08 22:54:52,882 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/a0ea21bd535f4b2c930eabd87480d054 2023-11-08 22:54:53,290 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/7dc5de4c9acd44fc8233c34cacf5440f 2023-11-08 22:54:53,305 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108cee3612590434462a20bbd49e7fd0109 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231108cee3612590434462a20bbd49e7fd0109 2023-11-08 22:54:53,310 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108002fe8a7f1b94475a56a26dc1421943e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231108002fe8a7f1b94475a56a26dc1421943e 2023-11-08 22:54:53,315 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/3222bbcf4c03432dab44603cbfe67390 2023-11-08 22:54:53,319 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/bdd764ab4f4f4de38970ee063cdcb11f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f 2023-11-08 22:54:53,326 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:53,326 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/3222bbcf4c03432dab44603cbfe67390 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390 2023-11-08 22:54:53,330 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:53,331 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7390e98da36ed002cdd3df703123f9e5 in 948ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:53,331 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:53,331 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:53,331 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:53,713 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110891644844e681494a922ec52faeab9571 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023110891644844e681494a922ec52faeab9571 2023-11-08 22:54:53,722 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/2f8962d99ae34a71906495843021c299 2023-11-08 22:54:53,727 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/a0ea21bd535f4b2c930eabd87480d054 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054 2023-11-08 22:54:53,733 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:53,735 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/2f8962d99ae34a71906495843021c299 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299 2023-11-08 22:54:53,740 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:53,741 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 1c95e8c8a1ca454a69d5f71fe09e2f2f in 1349ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:53,741 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:53,741 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:53,741 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:54,126 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/e31b3c95c1af436e89acc3170a14e5b7 2023-11-08 22:54:54,132 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/7dc5de4c9acd44fc8233c34cacf5440f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f 2023-11-08 22:54:54,135 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f, entries=4, sequenceid=9, filesize=5.4 K 2023-11-08 22:54:54,135 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/e31b3c95c1af436e89acc3170a14e5b7 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7 2023-11-08 22:54:54,139 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:54:54,142 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for de49c86467f227f556743d409603dd70 in 1765ms, sequenceid=9, compaction requested=false 2023-11-08 22:54:54,142 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:54,142 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-08 22:54:54,142 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-08 22:54:54,147 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,147 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:54,147 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:54,147 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:54,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:54,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-08 22:54:54,148 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-08 22:54:54,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f96e66[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:54,148 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,149 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-08 22:54:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-08 22:54:54,149 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:54,149 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,149 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:54,150 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-08 22:54:54,150 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,150 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:54,150 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-08 22:54:54,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:54,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:54,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-08 22:54:54,152 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-08 22:54:54,152 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:54,152 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:54,152 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-08 22:54:54,152 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:54,153 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,153 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,153 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:54,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:54,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:54,154 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:54,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,155 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:54,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:54,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:54,157 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:54,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:54,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-08 22:54:54,157 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:54,157 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:54,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:54,157 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:54,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:54,158 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:54,258 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:54,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:54,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:54,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:54,261 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:54,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:54,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:54,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-08 22:54:54,265 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-08 22:54:54,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:54,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-08 22:54:54,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-08 22:54:54,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,265 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:54,266 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,266 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:54,266 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:54,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:54,266 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:54,267 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:54,267 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-08 22:54:54,268 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-08 22:54:54,268 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-08 22:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-08 22:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:54,268 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-08 22:54:54,270 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:54,270 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. started... 2023-11-08 22:54:54,270 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing de49c86467f227f556743d409603dd70 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:54,273 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:54,274 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:54,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:54,274 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. started... 2023-11-08 22:54:54,274 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:54,274 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1c95e8c8a1ca454a69d5f71fe09e2f2f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:54,274 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. started... 2023-11-08 22:54:54,274 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7390e98da36ed002cdd3df703123f9e5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:54:54,312 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108e986e95a26a74ced81bd6876b7086204 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108e986e95a26a74ced81bd6876b7086204 2023-11-08 22:54:54,323 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311086b1da6ac4bda47f8b1b0d31453f4b7f1 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311086b1da6ac4bda47f8b1b0d31453f4b7f1 2023-11-08 22:54:54,716 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110832c648aced1f4098b1173445c72c2ce0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110832c648aced1f4098b1173445c72c2ce0 2023-11-08 22:54:54,728 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/f2ce9e53b77b4d48a7d654d77135e848 2023-11-08 22:54:54,737 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/0feb69c2bddb4452b64c8203dc3512b7 2023-11-08 22:54:54,750 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/54099569e7af42088ed682974233687c 2023-11-08 22:54:54,841 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108dc7c74bd2d0c4cae8ad4658b9188123f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231108dc7c74bd2d0c4cae8ad4658b9188123f 2023-11-08 22:54:55,089 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:54:55,224 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110828aa3ebc6183494da7378c026700517f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023110828aa3ebc6183494da7378c026700517f 2023-11-08 22:54:55,229 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311083051f069d8324e308e28982c820fb35a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311083051f069d8324e308e28982c820fb35a 2023-11-08 22:54:55,232 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/a15fd6177cd8451ca1ae80ab25132e0f 2023-11-08 22:54:55,242 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/f2ce9e53b77b4d48a7d654d77135e848 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848 2023-11-08 22:54:55,250 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:55,251 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/b23ac1c21cb34b029a07024747e4fae3 2023-11-08 22:54:55,251 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/a15fd6177cd8451ca1ae80ab25132e0f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f 2023-11-08 22:54:55,257 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:55,258 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/54099569e7af42088ed682974233687c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c 2023-11-08 22:54:55,258 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 1c95e8c8a1ca454a69d5f71fe09e2f2f in 984ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:55,258 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:55,258 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:55,258 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:55,261 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:55,262 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/b23ac1c21cb34b029a07024747e4fae3 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3 2023-11-08 22:54:55,268 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:55,269 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7390e98da36ed002cdd3df703123f9e5 in 995ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:55,270 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:55,270 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:55,270 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:55,638 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/e6f108ec59254dc89a208c43eaf851b5 2023-11-08 22:54:55,647 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/0feb69c2bddb4452b64c8203dc3512b7 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7 2023-11-08 22:54:55,654 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-08 22:54:55,655 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/e6f108ec59254dc89a208c43eaf851b5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5 2023-11-08 22:54:55,659 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:54:55,661 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for de49c86467f227f556743d409603dd70 in 1391ms, sequenceid=13, compaction requested=true 2023-11-08 22:54:55,661 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:55,661 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:55,661 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:55,661 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:55,661 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,661 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-08 22:54:55,661 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-08 22:54:55,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,664 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:55,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:55,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:55,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:55,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-08 22:54:55,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63dc77b6[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:55,673 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-08 22:54:55,674 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,679 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,679 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,679 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:55,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,681 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-08 22:54:55,682 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-08 22:54:55,682 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:55,683 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,683 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-08 22:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:55,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:55,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-08 22:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-08 22:54:55,687 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-08 22:54:55,687 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:55,687 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:55,687 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-08 22:54:55,687 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:55,696 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,696 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:55,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,696 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:55,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:55,696 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:55,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,697 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:55,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:55,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:55,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-08 22:54:55,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:55,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:55,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:55,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:55,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:55,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:55,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-08 22:54:55,804 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:55,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:55,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:55,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:55,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:54:55,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:55,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:55,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-08 22:54:55,816 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-08 22:54:55,816 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:55,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-08 22:54:55,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-08 22:54:55,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,817 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:55,818 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,818 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:55,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:55,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:55,819 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:55,819 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:55,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:55,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:55,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-08 22:54:55,821 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-08 22:54:55,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-08 22:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-08 22:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:55,821 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-08 22:54:55,821 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:55,821 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. started... 2023-11-08 22:54:55,821 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing de49c86467f227f556743d409603dd70 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:55,821 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:55,822 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. started... 2023-11-08 22:54:55,822 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7390e98da36ed002cdd3df703123f9e5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:55,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:55,823 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:55,823 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:55,823 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. started... 2023-11-08 22:54:55,823 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1c95e8c8a1ca454a69d5f71fe09e2f2f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:54:56,256 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108150e084c6c20435c8b738a4196472a35 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231108150e084c6c20435c8b738a4196472a35 2023-11-08 22:54:56,258 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311089abaea4dc8ac4525a301dc1c613619cf to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311089abaea4dc8ac4525a301dc1c613619cf 2023-11-08 22:54:56,264 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/a2b05685381a4ee7b46c3ba4b081b1f8 2023-11-08 22:54:56,271 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311082e067e6c66d04ca489e5dbbbaa6e5c7a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311082e067e6c66d04ca489e5dbbbaa6e5c7a 2023-11-08 22:54:56,280 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0 2023-11-08 22:54:56,282 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311082d6a6527aa73409a86dfc99e7fb9fe66 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311082d6a6527aa73409a86dfc99e7fb9fe66 2023-11-08 22:54:56,666 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/3a13de10b68949a7bd4b35bf3c73eb5e 2023-11-08 22:54:56,686 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/346d35861c0f47ea952825be7e9fd48b 2023-11-08 22:54:56,690 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/a2b05685381a4ee7b46c3ba4b081b1f8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8 2023-11-08 22:54:56,691 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108b1ccf2f4b6e544b2bd22459e1a8eb091 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231108b1ccf2f4b6e544b2bd22459e1a8eb091 2023-11-08 22:54:56,693 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:56,694 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/346d35861c0f47ea952825be7e9fd48b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b 2023-11-08 22:54:56,701 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/bbfde2d8d6854f04be1d50a4da1768d2 2023-11-08 22:54:56,706 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:56,707 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7390e98da36ed002cdd3df703123f9e5 in 884ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:56,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:56,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:56,707 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:56,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0 2023-11-08 22:54:56,710 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:56,711 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/bbfde2d8d6854f04be1d50a4da1768d2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2 2023-11-08 22:54:56,727 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:56,729 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for de49c86467f227f556743d409603dd70 in 908ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:56,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:56,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:56,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:57,084 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108e27ca943262b4a4393c405c65cce3e7f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231108e27ca943262b4a4393c405c65cce3e7f 2023-11-08 22:54:57,488 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/186c62a7d5724c73a5df28f43ee2497b 2023-11-08 22:54:57,495 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/3a13de10b68949a7bd4b35bf3c73eb5e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e 2023-11-08 22:54:57,501 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e, entries=4, sequenceid=17, filesize=5.4 K 2023-11-08 22:54:57,502 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/186c62a7d5724c73a5df28f43ee2497b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b 2023-11-08 22:54:57,510 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:54:57,511 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 1c95e8c8a1ca454a69d5f71fe09e2f2f in 1688ms, sequenceid=17, compaction requested=true 2023-11-08 22:54:57,511 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:57,511 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:57,511 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:57,511 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:57,511 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,511 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-08 22:54:57,511 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-08 22:54:57,515 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:57,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:57,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,515 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:57,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:57,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-08 22:54:57,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f3938b4[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:57,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-08 22:54:57,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,528 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,528 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-08 22:54:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-08 22:54:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:57,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,529 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:57,529 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-08 22:54:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:57,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:57,529 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:57,530 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-08 22:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:57,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-08 22:54:57,531 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-08 22:54:57,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:57,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:57,531 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-08 22:54:57,531 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:57,532 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,532 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,532 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:57,533 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:57,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,538 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,549 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:57,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-08 22:54:57,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:57,550 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:57,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:57,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:57,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:57,650 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:57,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:57,669 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:57,685 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:57,704 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:54:57,705 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:54:57,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:54:57,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-08 22:54:57,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-08 22:54:57,751 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-08 22:54:57,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:57,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-08 22:54:57,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-08 22:54:57,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,751 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:57,753 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:57,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:57,753 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:57,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:57,755 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:57,755 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:54:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:54:57,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:57,755 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-08 22:54:57,756 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-08 22:54:57,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-08 22:54:57,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-08 22:54:57,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:54:57,756 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-08 22:54:57,757 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:57,757 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. started... 2023-11-08 22:54:57,757 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing de49c86467f227f556743d409603dd70 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:57,758 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:57,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:54:57,758 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:54:57,758 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:57,758 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. started... 2023-11-08 22:54:57,758 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. started... 2023-11-08 22:54:57,758 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 7390e98da36ed002cdd3df703123f9e5 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:57,758 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 1c95e8c8a1ca454a69d5f71fe09e2f2f 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:54:58,201 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/2865b1e4b51943f9a8586cda13382859 2023-11-08 22:54:58,205 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2865b1e4b51943f9a8586cda13382859 2023-11-08 22:54:58,206 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/9ebaf6c7bfff445991187e900c58336b 2023-11-08 22:54:58,218 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ebaf6c7bfff445991187e900c58336b 2023-11-08 22:54:58,611 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08 2023-11-08 22:54:58,614 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6bc7f84d79d4b4b9b4bdba44bf77a08 2023-11-08 22:54:58,638 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/1c98eb26d51f4ac6b30117fb40a85cd3 2023-11-08 22:54:58,641 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c98eb26d51f4ac6b30117fb40a85cd3 2023-11-08 22:54:58,642 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/2865b1e4b51943f9a8586cda13382859 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859 2023-11-08 22:54:58,646 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2865b1e4b51943f9a8586cda13382859 2023-11-08 22:54:58,646 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859, entries=3, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:58,647 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/1c98eb26d51f4ac6b30117fb40a85cd3 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3 2023-11-08 22:54:58,653 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1c98eb26d51f4ac6b30117fb40a85cd3 2023-11-08 22:54:58,653 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:58,654 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for de49c86467f227f556743d409603dd70 in 897ms, sequenceid=23, compaction requested=true 2023-11-08 22:54:58,654 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:58,654 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:58,654 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:54:59,024 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/676c37836f7341829ea01a4234bb7a22 2023-11-08 22:54:59,030 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 676c37836f7341829ea01a4234bb7a22 2023-11-08 22:54:59,031 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08 2023-11-08 22:54:59,036 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f6bc7f84d79d4b4b9b4bdba44bf77a08 2023-11-08 22:54:59,037 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08, entries=3, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:59,037 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/676c37836f7341829ea01a4234bb7a22 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22 2023-11-08 22:54:59,045 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 676c37836f7341829ea01a4234bb7a22 2023-11-08 22:54:59,045 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:59,046 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 1c95e8c8a1ca454a69d5f71fe09e2f2f in 1288ms, sequenceid=23, compaction requested=true 2023-11-08 22:54:59,046 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:54:59,046 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:54:59,046 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:54:59,054 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/623e73f76ff140298f6664d2e1b33869 2023-11-08 22:54:59,062 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 623e73f76ff140298f6664d2e1b33869 2023-11-08 22:54:59,062 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/9ebaf6c7bfff445991187e900c58336b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b 2023-11-08 22:54:59,070 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ebaf6c7bfff445991187e900c58336b 2023-11-08 22:54:59,070 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b, entries=3, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:59,071 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/623e73f76ff140298f6664d2e1b33869 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869 2023-11-08 22:54:59,075 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 623e73f76ff140298f6664d2e1b33869 2023-11-08 22:54:59,076 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:54:59,076 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7390e98da36ed002cdd3df703123f9e5 in 1318ms, sequenceid=23, compaction requested=true 2023-11-08 22:54:59,076 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:54:59,077 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:54:59,077 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:54:59,077 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:54:59,077 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,077 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-08 22:54:59,077 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-08 22:54:59,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,078 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:59,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,078 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:54:59,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-08 22:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60402889[Count = 0] remaining members to acquire global barrier 2023-11-08 22:54:59,080 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-08 22:54:59,080 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,080 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:54:59,081 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,081 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-08 22:54:59,081 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,081 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-08 22:54:59,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:59,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:54:59,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-08 22:54:59,084 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-08 22:54:59,084 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:54:59,084 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:54:59,084 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-08 22:54:59,084 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:54:59,085 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:54:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:54:59,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:59,085 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,086 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:54:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-08 22:54:59,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:54:59,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:54:59,091 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:54:59,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-08 22:54:59,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:54:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-08 22:54:59,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:54:59,091 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:54:59,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:54:59,191 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:54:59,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:54:59,192 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:59,193 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): de49c86467f227f556743d409603dd70/family1 is initiating major compaction (all files) 2023-11-08 22:54:59,193 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:59,193 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:59,193 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of de49c86467f227f556743d409603dd70/family1 in ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:59,193 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp, totalSize=26.6 K 2023-11-08 22:54:59,194 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting cf042504b79c4120af2b0c1369a483f0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090549 2023-11-08 22:54:59,195 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 7dc5de4c9acd44fc8233c34cacf5440f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:54:59,196 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 0feb69c2bddb4452b64c8203dc3512b7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094260 2023-11-08 22:54:59,197 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f9f4a1e3dfdd4e64ab774a258eb16bd0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:54:59,197 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 2865b1e4b51943f9a8586cda13382859, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:54:59,210 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): de49c86467f227f556743d409603dd70#family1#compaction#148 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:59,227 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231108f6b293f78d204a16bb9bd3a2115fa1a8_del 2023-11-08 22:54:59,227 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108f6b293f78d204a16bb9bd3a2115fa1a8_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108f6b293f78d204a16bb9bd3a2115fa1a8_del 2023-11-08 22:54:59,650 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e97ee83b2d8c4d07b131335e23c76375 2023-11-08 22:54:59,651 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family1/e97ee83b2d8c4d07b131335e23c76375 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/e97ee83b2d8c4d07b131335e23c76375 2023-11-08 22:54:59,655 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e97ee83b2d8c4d07b131335e23c76375 2023-11-08 22:54:59,656 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in de49c86467f227f556743d409603dd70/family1 of de49c86467f227f556743d409603dd70 into e97ee83b2d8c4d07b131335e23c76375(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:54:59,656 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:54:59,656 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:54:59,656 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): de49c86467f227f556743d409603dd70/family2 is initiating major compaction (all files) 2023-11-08 22:54:59,656 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:54:59,656 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:54:59,659 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of de49c86467f227f556743d409603dd70/family2 in ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:54:59,659 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp, totalSize=25.3 K 2023-11-08 22:54:59,659 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5f83fbdb963a46a792f39b401d8c6967, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090549 2023-11-08 22:54:59,660 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting e31b3c95c1af436e89acc3170a14e5b7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:54:59,660 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting e6f108ec59254dc89a208c43eaf851b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094260 2023-11-08 22:54:59,660 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting bbfde2d8d6854f04be1d50a4da1768d2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:54:59,661 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 1c98eb26d51f4ac6b30117fb40a85cd3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:54:59,670 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): de49c86467f227f556743d409603dd70#family2#compaction#149 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:54:59,682 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311088d5cf932bd9e4e3b9af7b2298320692d_del 2023-11-08 22:54:59,683 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311088d5cf932bd9e4e3b9af7b2298320692d_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202311088d5cf932bd9e4e3b9af7b2298320692d_del 2023-11-08 22:54:59,689 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859] to archive 2023-11-08 22:54:59,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:54:59,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/cf042504b79c4120af2b0c1369a483f0 2023-11-08 22:54:59,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/7dc5de4c9acd44fc8233c34cacf5440f 2023-11-08 22:54:59,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/0feb69c2bddb4452b64c8203dc3512b7 2023-11-08 22:54:59,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/f9f4a1e3dfdd4e64ab774a258eb16bd0 2023-11-08 22:54:59,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/2865b1e4b51943f9a8586cda13382859 2023-11-08 22:55:00,114 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 960ffc660e37428a8da29f1c2fa8a430 2023-11-08 22:55:00,114 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/.tmp/family2/960ffc660e37428a8da29f1c2fa8a430 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/960ffc660e37428a8da29f1c2fa8a430 2023-11-08 22:55:00,118 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 960ffc660e37428a8da29f1c2fa8a430 2023-11-08 22:55:00,119 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in de49c86467f227f556743d409603dd70/family2 of de49c86467f227f556743d409603dd70 into 960ffc660e37428a8da29f1c2fa8a430(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:00,119 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:55:00,119 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:00,119 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 7390e98da36ed002cdd3df703123f9e5/family1 is initiating major compaction (all files) 2023-11-08 22:55:00,119 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:00,119 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:00,119 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 7390e98da36ed002cdd3df703123f9e5/family1 in ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:00,119 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp, totalSize=26.6 K 2023-11-08 22:55:00,120 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 3dee89b0942a4f279f7231132f9229fd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090550 2023-11-08 22:55:00,120 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting bdd764ab4f4f4de38970ee063cdcb11f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:55:00,121 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 54099569e7af42088ed682974233687c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094260 2023-11-08 22:55:00,121 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a2b05685381a4ee7b46c3ba4b081b1f8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:55:00,121 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 9ebaf6c7bfff445991187e900c58336b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:00,135 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 7390e98da36ed002cdd3df703123f9e5#family1#compaction#150 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:00,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3] to archive 2023-11-08 22:55:00,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:00,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/5f83fbdb963a46a792f39b401d8c6967 2023-11-08 22:55:00,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e31b3c95c1af436e89acc3170a14e5b7 2023-11-08 22:55:00,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/e6f108ec59254dc89a208c43eaf851b5 2023-11-08 22:55:00,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/bbfde2d8d6854f04be1d50a4da1768d2 2023-11-08 22:55:00,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family2/1c98eb26d51f4ac6b30117fb40a85cd3 2023-11-08 22:55:00,553 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110881346b0f3c5f4e7fa2a83608c77746e5_del 2023-11-08 22:55:00,553 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110881346b0f3c5f4e7fa2a83608c77746e5_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023110881346b0f3c5f4e7fa2a83608c77746e5_del 2023-11-08 22:55:01,384 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdee156e784a49cba29b82bc0259ff4b 2023-11-08 22:55:01,385 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family1/fdee156e784a49cba29b82bc0259ff4b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/fdee156e784a49cba29b82bc0259ff4b 2023-11-08 22:55:01,391 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fdee156e784a49cba29b82bc0259ff4b 2023-11-08 22:55:01,392 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7390e98da36ed002cdd3df703123f9e5/family1 of 7390e98da36ed002cdd3df703123f9e5 into fdee156e784a49cba29b82bc0259ff4b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:55:01,393 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:55:01,393 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:01,393 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 7390e98da36ed002cdd3df703123f9e5/family2 is initiating major compaction (all files) 2023-11-08 22:55:01,393 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:01,393 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:01,394 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 7390e98da36ed002cdd3df703123f9e5/family2 in ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:01,394 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp, totalSize=25.3 K 2023-11-08 22:55:01,394 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting c815f757b36b45b3af8d46f7fad6f3b2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090550 2023-11-08 22:55:01,395 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 3222bbcf4c03432dab44603cbfe67390, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:55:01,396 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting b23ac1c21cb34b029a07024747e4fae3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094260 2023-11-08 22:55:01,396 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 346d35861c0f47ea952825be7e9fd48b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:55:01,397 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 623e73f76ff140298f6664d2e1b33869, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:01,409 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 7390e98da36ed002cdd3df703123f9e5#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:01,490 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b] to archive 2023-11-08 22:55:01,494 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:01,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/3dee89b0942a4f279f7231132f9229fd 2023-11-08 22:55:01,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/bdd764ab4f4f4de38970ee063cdcb11f 2023-11-08 22:55:01,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/54099569e7af42088ed682974233687c 2023-11-08 22:55:01,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/a2b05685381a4ee7b46c3ba4b081b1f8 2023-11-08 22:55:01,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/9ebaf6c7bfff445991187e900c58336b 2023-11-08 22:55:01,822 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110806d7b8605897475bb2c32bc1a166b1b7_del 2023-11-08 22:55:01,822 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110806d7b8605897475bb2c32bc1a166b1b7_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023110806d7b8605897475bb2c32bc1a166b1b7_del 2023-11-08 22:55:02,646 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c707d389c3dd4154a2d62c14690d9eb8 2023-11-08 22:55:02,648 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/.tmp/family2/c707d389c3dd4154a2d62c14690d9eb8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c707d389c3dd4154a2d62c14690d9eb8 2023-11-08 22:55:02,655 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c707d389c3dd4154a2d62c14690d9eb8 2023-11-08 22:55:02,656 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7390e98da36ed002cdd3df703123f9e5/family2 of 7390e98da36ed002cdd3df703123f9e5 into c707d389c3dd4154a2d62c14690d9eb8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:55:02,656 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:55:02,656 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:02,656 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 is initiating major compaction (all files) 2023-11-08 22:55:02,656 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:02,656 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:02,656 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 in ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:02,657 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp, totalSize=26.6 K 2023-11-08 22:55:02,657 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a71fecb3728e47859d8b21f3b1912e50, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090550 2023-11-08 22:55:02,658 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a0ea21bd535f4b2c930eabd87480d054, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:55:02,658 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f2ce9e53b77b4d48a7d654d77135e848, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094261 2023-11-08 22:55:02,658 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 3a13de10b68949a7bd4b35bf3c73eb5e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:55:02,659 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f6bc7f84d79d4b4b9b4bdba44bf77a08, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:02,666 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 1c95e8c8a1ca454a69d5f71fe09e2f2f#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:02,690 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869] to archive 2023-11-08 22:55:02,691 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:02,692 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/c815f757b36b45b3af8d46f7fad6f3b2 2023-11-08 22:55:02,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/3222bbcf4c03432dab44603cbfe67390 2023-11-08 22:55:02,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/b23ac1c21cb34b029a07024747e4fae3 2023-11-08 22:55:02,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/346d35861c0f47ea952825be7e9fd48b 2023-11-08 22:55:02,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family2/623e73f76ff140298f6664d2e1b33869 2023-11-08 22:55:03,084 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110876f22b3052e04302a4bcb36e2219b582_del 2023-11-08 22:55:03,085 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110876f22b3052e04302a4bcb36e2219b582_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023110876f22b3052e04302a4bcb36e2219b582_del 2023-11-08 22:55:03,910 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da550919654493cbaf566d8f688ca63 2023-11-08 22:55:03,911 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family1/8da550919654493cbaf566d8f688ca63 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/8da550919654493cbaf566d8f688ca63 2023-11-08 22:55:03,915 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8da550919654493cbaf566d8f688ca63 2023-11-08 22:55:03,916 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 of 1c95e8c8a1ca454a69d5f71fe09e2f2f into 8da550919654493cbaf566d8f688ca63(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:55:03,916 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:55:03,916 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:03,916 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): 1c95e8c8a1ca454a69d5f71fe09e2f2f/family2 is initiating major compaction (all files) 2023-11-08 22:55:03,916 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:03,916 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:03,917 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of 1c95e8c8a1ca454a69d5f71fe09e2f2f/family2 in ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:03,917 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp, totalSize=25.3 K 2023-11-08 22:55:03,917 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 43665e48f98b40c5a03025569064bb4e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484090550 2023-11-08 22:55:03,917 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 2f8962d99ae34a71906495843021c299, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484092359 2023-11-08 22:55:03,918 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a15fd6177cd8451ca1ae80ab25132e0f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484094261 2023-11-08 22:55:03,918 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 186c62a7d5724c73a5df28f43ee2497b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484095807 2023-11-08 22:55:03,918 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 676c37836f7341829ea01a4234bb7a22, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:03,927 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): 1c95e8c8a1ca454a69d5f71fe09e2f2f#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:03,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08] to archive 2023-11-08 22:55:03,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:04,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a71fecb3728e47859d8b21f3b1912e50 2023-11-08 22:55:04,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/a0ea21bd535f4b2c930eabd87480d054 2023-11-08 22:55:04,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f2ce9e53b77b4d48a7d654d77135e848 2023-11-08 22:55:04,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/3a13de10b68949a7bd4b35bf3c73eb5e 2023-11-08 22:55:04,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/f6bc7f84d79d4b4b9b4bdba44bf77a08 2023-11-08 22:55:04,340 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231108b5f149532a6f4af684d32c8adb88f685_del 2023-11-08 22:55:04,340 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108b5f149532a6f4af684d32c8adb88f685_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231108b5f149532a6f4af684d32c8adb88f685_del 2023-11-08 22:55:04,762 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9a7c582be2249179ef9617e63124a54 2023-11-08 22:55:04,763 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/.tmp/family2/e9a7c582be2249179ef9617e63124a54 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/e9a7c582be2249179ef9617e63124a54 2023-11-08 22:55:04,767 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e9a7c582be2249179ef9617e63124a54 2023-11-08 22:55:04,768 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 1c95e8c8a1ca454a69d5f71fe09e2f2f/family2 of 1c95e8c8a1ca454a69d5f71fe09e2f2f into e9a7c582be2249179ef9617e63124a54(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:04,768 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:55:04,772 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:04,774 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:04,778 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:04,778 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:04,783 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:55:04,792 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22] to archive 2023-11-08 22:55:04,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:04,794 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/43665e48f98b40c5a03025569064bb4e 2023-11-08 22:55:04,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/2f8962d99ae34a71906495843021c299 2023-11-08 22:55:04,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/a15fd6177cd8451ca1ae80ab25132e0f 2023-11-08 22:55:04,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/186c62a7d5724c73a5df28f43ee2497b 2023-11-08 22:55:04,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family2/676c37836f7341829ea01a4234bb7a22 2023-11-08 22:55:04,799 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-08 22:55:04,802 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231108f6b293f78d204a16bb9bd3a2115fa1a8_del 2023-11-08 22:55:04,805 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110881346b0f3c5f4e7fa2a83608c77746e5_del 2023-11-08 22:55:04,808 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110876f22b3052e04302a4bcb36e2219b582_del 2023-11-08 22:55:04,808 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:04,808 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(139): Connect 0x35a032c1 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:55:04,812 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71842863, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:55:04,813 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:04,813 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:04,813 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:05,241 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311089a2f87929d8e4400a89c05cf2d964583 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311089a2f87929d8e4400a89c05cf2d964583 2023-11-08 22:55:05,242 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110875d18cc8d2f046b9ab3b7896217af931 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023110875d18cc8d2f046b9ab3b7896217af931 2023-11-08 22:55:05,242 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,242 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,261 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:55:05,264 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37288, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:55:05,270 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:55:05,277 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54296, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:55:05,290 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/family1/f1812000adeb4f12a97c4c99e020a59f first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-08 22:55:05,290 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231108/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-08 22:55:05,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231108/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b}] 2023-11-08 22:55:05,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/family1/f1812000adeb4f12a97c4c99e020a59f}] 2023-11-08 22:55:05,298 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/family1/f1812000adeb4f12a97c4c99e020a59f for inclusion in de49c86467f227f556743d409603dd70/family1 2023-11-08 22:55:05,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231108/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b for inclusion in 7390e98da36ed002cdd3df703123f9e5/family1 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last=1 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:55:05,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:55:05,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231108/family1/f1812000adeb4f12a97c4c99e020a59f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__dj7dumf1du49v3pg17pb4in0vbb8187i7j8ee6d75mum4t0v4ef6kjjj1oe8kg0a/family1/f1812000adeb4f12a97c4c99e020a59f 2023-11-08 22:55:05,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231108/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__v63omf9ure9lif836cddunpgk7o0ndjbt9iirlp5st9aic5ethjdrqb4ppk4lj9k/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b 2023-11-08 22:55:05,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__v63omf9ure9lif836cddunpgk7o0ndjbt9iirlp5st9aic5ethjdrqb4ppk4lj9k/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/418b7b19d3d1404c99c19ecd839295c0_SeqId_28_ 2023-11-08 22:55:05,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__dj7dumf1du49v3pg17pb4in0vbb8187i7j8ee6d75mum4t0v4ef6kjjj1oe8kg0a/family1/f1812000adeb4f12a97c4c99e020a59f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/d1f90aab0ffa43fc9821b6e837943611_SeqId_28_ 2023-11-08 22:55:05,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__v63omf9ure9lif836cddunpgk7o0ndjbt9iirlp5st9aic5ethjdrqb4ppk4lj9k/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b into 7390e98da36ed002cdd3df703123f9e5/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/418b7b19d3d1404c99c19ecd839295c0_SeqId_28_ - updating store file list. 2023-11-08 22:55:05,303 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__dj7dumf1du49v3pg17pb4in0vbb8187i7j8ee6d75mum4t0v4ef6kjjj1oe8kg0a/family1/f1812000adeb4f12a97c4c99e020a59f into de49c86467f227f556743d409603dd70/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/d1f90aab0ffa43fc9821b6e837943611_SeqId_28_ - updating store file list. 2023-11-08 22:55:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/d1f90aab0ffa43fc9821b6e837943611_SeqId_28_ into de49c86467f227f556743d409603dd70/family1 2023-11-08 22:55:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__dj7dumf1du49v3pg17pb4in0vbb8187i7j8ee6d75mum4t0v4ef6kjjj1oe8kg0a/family1/f1812000adeb4f12a97c4c99e020a59f into de49c86467f227f556743d409603dd70/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/family1/d1f90aab0ffa43fc9821b6e837943611_SeqId_28_) 2023-11-08 22:55:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/418b7b19d3d1404c99c19ecd839295c0_SeqId_28_ into 7390e98da36ed002cdd3df703123f9e5/family1 2023-11-08 22:55:05,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__v63omf9ure9lif836cddunpgk7o0ndjbt9iirlp5st9aic5ethjdrqb4ppk4lj9k/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b into 7390e98da36ed002cdd3df703123f9e5/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/family1/418b7b19d3d1404c99c19ecd839295c0_SeqId_28_) 2023-11-08 22:55:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__dj7dumf1du49v3pg17pb4in0vbb8187i7j8ee6d75mum4t0v4ef6kjjj1oe8kg0a/family1/f1812000adeb4f12a97c4c99e020a59f 2023-11-08 22:55:05,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__v63omf9ure9lif836cddunpgk7o0ndjbt9iirlp5st9aic5ethjdrqb4ppk4lj9k/family1/9486aa1fe0ad4bb3b734616ecd9ffe6b 2023-11-08 22:55:05,308 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,308 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,308 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:05,308 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:05,309 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311080c9fa8ec598649dc9b5482bef60e59d7 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202311080c9fa8ec598649dc9b5482bef60e59d7 2023-11-08 22:55:05,309 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-08 22:55:05,309 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231108' 2023-11-08 22:55:05,310 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108785808a4787f4a5f8f4e93206346be37 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231108785808a4787f4a5f8f4e93206346be37 2023-11-08 22:55:05,310 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-08 22:55:05,310 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231108' 2023-11-08 22:55:05,310 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:05,310 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:05,645 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108fd2ed91c5f73466399dace0138e96c44 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231108fd2ed91c5f73466399dace0138e96c44 2023-11-08 22:55:05,647 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,672 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231108/family1/b27a90b3439b4261b2090bd4cf462e3f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-08 22:55:05,673 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231108/family1/b27a90b3439b4261b2090bd4cf462e3f}] 2023-11-08 22:55:05,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231108/family1/b27a90b3439b4261b2090bd4cf462e3f for inclusion in 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 2023-11-08 22:55:05,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-08 22:55:05,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-08 22:55:05,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:55:05,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231108/family1/b27a90b3439b4261b2090bd4cf462e3f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__7u1mj4mf8sg48jcoes1souhvce9nqo4cru1o09babo7jo9bucc4q542173lo0k8v/family1/b27a90b3439b4261b2090bd4cf462e3f 2023-11-08 22:55:05,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__7u1mj4mf8sg48jcoes1souhvce9nqo4cru1o09babo7jo9bucc4q542173lo0k8v/family1/b27a90b3439b4261b2090bd4cf462e3f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/c0d15f3539114dd49c8a7c645eb5b8ff_SeqId_28_ 2023-11-08 22:55:05,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__7u1mj4mf8sg48jcoes1souhvce9nqo4cru1o09babo7jo9bucc4q542173lo0k8v/family1/b27a90b3439b4261b2090bd4cf462e3f into 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/c0d15f3539114dd49c8a7c645eb5b8ff_SeqId_28_ - updating store file list. 2023-11-08 22:55:05,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/c0d15f3539114dd49c8a7c645eb5b8ff_SeqId_28_ into 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 2023-11-08 22:55:05,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__7u1mj4mf8sg48jcoes1souhvce9nqo4cru1o09babo7jo9bucc4q542173lo0k8v/family1/b27a90b3439b4261b2090bd4cf462e3f into 1c95e8c8a1ca454a69d5f71fe09e2f2f/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/family1/c0d15f3539114dd49c8a7c645eb5b8ff_SeqId_28_) 2023-11-08 22:55:05,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__ns_testMinorCompaction__7u1mj4mf8sg48jcoes1souhvce9nqo4cru1o09babo7jo9bucc4q542173lo0k8v/family1/b27a90b3439b4261b2090bd4cf462e3f 2023-11-08 22:55:05,683 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,684 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:05,685 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311081a42c2d082e7497caa551431551d99e0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311081a42c2d082e7497caa551431551d99e0 2023-11-08 22:55:05,685 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-08 22:55:05,685 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231108' 2023-11-08 22:55:05,685 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231108 for table='ns:testMinorCompaction' and column='family1' 2023-11-08 22:55:05,685 INFO [Listener at localhost/37975] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-08 22:55:05,688 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:05,690 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:05,693 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:05,694 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:05,710 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=250 (was 292), OpenFileDescriptor=657 (was 801), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 110) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=5867 (was 5870) 2023-11-08 22:55:05,724 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=657, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=167, AvailableMemoryMB=5867 2023-11-08 22:55:05,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-08 22:55:05,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:05,729 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:55:05,729 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-08 22:55:05,730 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:55:05,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-08 22:55:05,731 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:05,732 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f empty. 2023-11-08 22:55:05,732 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:05,732 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-08 22:55:05,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-08 22:55:06,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-08 22:55:06,144 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-08 22:55:06,148 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c8a0a067b314367bbe438d0c388c44f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 8c8a0a067b314367bbe438d0c388c44f, disabling compactions & flushes 2023-11-08 22:55:06,160 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. after waiting 0 ms 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,160 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,160 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:06,163 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:55:06,164 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699484106164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484106164"}]},"ts":"1699484106164"} 2023-11-08 22:55:06,166 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-08 22:55:06,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:55:06,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484106167"}]},"ts":"1699484106167"} 2023-11-08 22:55:06,168 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-08 22:55:06,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=8c8a0a067b314367bbe438d0c388c44f, ASSIGN}] 2023-11-08 22:55:06,173 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=8c8a0a067b314367bbe438d0c388c44f, ASSIGN 2023-11-08 22:55:06,174 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=8c8a0a067b314367bbe438d0c388c44f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:55:06,325 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=8c8a0a067b314367bbe438d0c388c44f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:06,326 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699484106325"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484106325"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484106325"}]},"ts":"1699484106325"} 2023-11-08 22:55:06,329 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 8c8a0a067b314367bbe438d0c388c44f, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:55:06,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-08 22:55:06,482 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:06,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c8a0a067b314367bbe438d0c388c44f, NAME => 'testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.', STARTKEY => '', ENDKEY => ''} 2023-11-08 22:55:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:06,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,492 INFO [StoreOpener-8c8a0a067b314367bbe438d0c388c44f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,495 DEBUG [StoreOpener-8c8a0a067b314367bbe438d0c388c44f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:06,495 DEBUG [StoreOpener-8c8a0a067b314367bbe438d0c388c44f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:06,496 INFO [StoreOpener-8c8a0a067b314367bbe438d0c388c44f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c8a0a067b314367bbe438d0c388c44f columnFamilyName family1 2023-11-08 22:55:06,499 INFO [StoreOpener-8c8a0a067b314367bbe438d0c388c44f-1] regionserver.HStore(310): Store=8c8a0a067b314367bbe438d0c388c44f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:06,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:06,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:55:06,506 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 8c8a0a067b314367bbe438d0c388c44f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66134530, jitterRate=-0.014518707990646362}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-08 22:55:06,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:06,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., pid=114, masterSystemTime=1699484106482 2023-11-08 22:55:06,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,508 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=8c8a0a067b314367bbe438d0c388c44f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:06,509 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1699484106508"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484106508"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484106508"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484106508"}]},"ts":"1699484106508"} 2023-11-08 22:55:06,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-11-08 22:55:06,511 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 8c8a0a067b314367bbe438d0c388c44f, server=jenkins-hbase20.apache.org,35543,1699483966133 in 181 msec 2023-11-08 22:55:06,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-11-08 22:55:06,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=8c8a0a067b314367bbe438d0c388c44f, ASSIGN in 339 msec 2023-11-08 22:55:06,512 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:55:06,512 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484106512"}]},"ts":"1699484106512"} 2023-11-08 22:55:06,513 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-08 22:55:06,515 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:55:06,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 788 msec 2023-11-08 22:55:06,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-08 22:55:06,840 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-08 22:55:06,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:06,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,862 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:06,862 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:06,862 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:06,862 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:06,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,864 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:06,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:06,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:06,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:06,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:06,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,865 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:06,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,865 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,865 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:06,865 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:06,865 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:06,865 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:06,865 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:06,865 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:06,865 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:06,865 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:06,866 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-08 22:55:07,298 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301957f33b841c4714aa2b1d931394a2a5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301957f33b841c4714aa2b1d931394a2a5 2023-11-08 22:55:07,704 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/f3428f270b3b483bac1193641dd864f2 2023-11-08 22:55:07,709 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:07,715 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/f3428f270b3b483bac1193641dd864f2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2 2023-11-08 22:55:07,721 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-08 22:55:07,722 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 856ms, sequenceid=5, compaction requested=false 2023-11-08 22:55:07,723 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:07,723 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:07,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:07,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:07,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:07,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:07,725 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,725 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:07,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:07,725 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,725 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:07,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:07,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:07,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dc7f0b9[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:07,728 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:07,728 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,729 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:07,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:07,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:07,729 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,729 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:07,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:07,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:07,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:07,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:07,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:07,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:07,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:07,735 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:07,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:07,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:07,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,735 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:07,744 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,744 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:07,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,744 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:07,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:07,745 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:07,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,748 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:07,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:07,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:07,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:07,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:07,752 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:07,752 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,753 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,753 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:07,753 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:07,753 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,754 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:07,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:07,854 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:07,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:07,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:07,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:07,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,868 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:07,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:07,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:07,868 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:07,869 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,869 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,870 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,870 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:07,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:07,871 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:07,871 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:07,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,873 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,873 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:07,873 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:07,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:07,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:07,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:07,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:07,873 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:07,874 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:07,874 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:07,874 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-08 22:55:08,297 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511285aa922e52e6b4c339cc677ef876b9515 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511285aa922e52e6b4c339cc677ef876b9515 2023-11-08 22:55:08,704 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/491e5b111b304be4983983875dfd4324 2023-11-08 22:55:08,716 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/491e5b111b304be4983983875dfd4324 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324 2023-11-08 22:55:08,720 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324, entries=1, sequenceid=9, filesize=5.0 K 2023-11-08 22:55:08,721 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 847ms, sequenceid=9, compaction requested=false 2023-11-08 22:55:08,721 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:08,721 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:08,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:08,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:08,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,722 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:08,722 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:08,723 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,723 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:08,724 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,724 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:08,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:08,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:08,726 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d265b70[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:08,726 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:08,726 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,726 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,726 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:08,726 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:08,726 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:08,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:08,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:08,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:08,727 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,727 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:08,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:08,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:08,730 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:08,730 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:08,730 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:08,730 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,730 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:08,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:08,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:08,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:08,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:08,734 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:08,734 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:08,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:08,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:08,734 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:08,835 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:08,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:08,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:08,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:08,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,845 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:08,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:08,845 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:08,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:08,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,846 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,848 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:08,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:08,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:08,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:08,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:08,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,850 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:08,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,851 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,852 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:08,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:08,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:08,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:08,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:08,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:08,852 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:08,853 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:08,853 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:08,853 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:09,277 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201637d474878264dd9975c37fc7d6451fd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201637d474878264dd9975c37fc7d6451fd 2023-11-08 22:55:09,686 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/3704ee5fb3174d62b164f56cfa7271a8 2023-11-08 22:55:09,701 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/3704ee5fb3174d62b164f56cfa7271a8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8 2023-11-08 22:55:09,708 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8, entries=1, sequenceid=13, filesize=4.9 K 2023-11-08 22:55:09,709 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 856ms, sequenceid=13, compaction requested=true 2023-11-08 22:55:09,710 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:09,710 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:09,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:09,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:09,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:09,710 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:09,712 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:09,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:09,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:09,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:09,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:09,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:09,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:09,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@18e930bc[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:09,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:09,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,719 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,719 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:09,719 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:09,719 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:09,719 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,719 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:09,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:09,721 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:09,721 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:09,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:09,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:09,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:09,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:09,727 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:09,727 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:09,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:09,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:09,727 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,727 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:09,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:09,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:09,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:09,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:09,739 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:09,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,742 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:09,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,748 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:09,747 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:09,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:09,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:09,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:09,748 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:55:09,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:09,749 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:09,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:09,748 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,749 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:09,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:09,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:09,849 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:09,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:09,860 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:09,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:09,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,863 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:09,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:09,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:09,863 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:09,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,864 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,866 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:09,866 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:09,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:09,866 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:09,867 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:09,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:09,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,868 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,869 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:09,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:09,869 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:09,869 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:09,869 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:09,869 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:09,869 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:09,869 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:09,869 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:09,869 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:10,280 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c05a56c3f7ae47c2aabb254c30b7ab6a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c05a56c3f7ae47c2aabb254c30b7ab6a 2023-11-08 22:55:10,688 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/42e5f577501d44f28a0033c58d324bb6 2023-11-08 22:55:10,694 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/42e5f577501d44f28a0033c58d324bb6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6 2023-11-08 22:55:10,700 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6, entries=1, sequenceid=17, filesize=4.9 K 2023-11-08 22:55:10,701 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 832ms, sequenceid=17, compaction requested=true 2023-11-08 22:55:10,702 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:10,702 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:10,702 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:10,702 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:10,702 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,702 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:10,702 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:10,704 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:10,705 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,705 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:10,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:10,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47cb050a[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:10,708 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:10,708 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,712 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:10,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:10,712 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:10,712 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,712 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:10,713 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:10,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:10,713 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:10,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:10,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:10,715 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:10,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:10,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:10,715 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,715 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:10,716 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,716 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:10,716 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:10,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:10,717 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,718 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,719 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,719 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,719 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:10,719 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:10,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:55:10,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:10,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,720 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:10,720 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:10,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:10,820 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:10,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:10,825 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:10,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:10,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,826 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:10,826 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:10,826 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:10,826 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:10,826 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,827 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,827 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:10,827 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:10,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:10,828 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:10,828 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:10,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,828 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,828 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:10,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:10,829 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:10,829 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:10,829 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:10,829 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:10,829 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:10,829 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:10,829 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:10,829 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:11,240 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f9e02ad28c3d408db95a0a9211aeb7ab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9e02ad28c3d408db95a0a9211aeb7ab 2023-11-08 22:55:11,645 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/766889a8634e44ea9640fa0d29b364b0 2023-11-08 22:55:11,650 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/766889a8634e44ea9640fa0d29b364b0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0 2023-11-08 22:55:11,657 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0, entries=1, sequenceid=21, filesize=4.9 K 2023-11-08 22:55:11,658 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 829ms, sequenceid=21, compaction requested=true 2023-11-08 22:55:11,658 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:11,658 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:11,658 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:11,659 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,660 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:11,660 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,660 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:11,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:11,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d0a64e9[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:11,661 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:11,661 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,663 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:11,663 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:11,663 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,663 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:11,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:11,664 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:11,664 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:11,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:11,666 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:11,666 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:11,666 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:11,666 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,666 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:11,667 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,667 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:11,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,667 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:11,668 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:11,669 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:11,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:11,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:11,671 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,671 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:11,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:11,672 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,672 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:11,672 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,772 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:11,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:11,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:11,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:11,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,778 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:11,778 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:11,778 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:11,778 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:11,779 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,779 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,780 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:11,780 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:11,780 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:11,780 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:11,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:11,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,781 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,781 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:11,781 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:11,781 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:11,781 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:11,781 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:11,781 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:11,781 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:11,781 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:11,781 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:11,781 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:12,031 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:55:12,190 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123198cc27d194274e13a53a4d104d95cd27 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123198cc27d194274e13a53a4d104d95cd27 2023-11-08 22:55:12,595 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/0e72548e6765448dae54c31c56723f4f 2023-11-08 22:55:12,599 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/0e72548e6765448dae54c31c56723f4f as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f 2023-11-08 22:55:12,602 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f, entries=1, sequenceid=25, filesize=4.9 K 2023-11-08 22:55:12,603 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 822ms, sequenceid=25, compaction requested=true 2023-11-08 22:55:12,603 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:12,603 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:12,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:12,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:12,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:12,603 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:12,604 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,604 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:12,605 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,605 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:12,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:12,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:12,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d684469[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:12,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:12,607 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,608 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,609 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:12,609 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:12,609 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:12,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,609 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:12,609 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:12,610 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:12,610 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:12,610 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:12,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:12,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:12,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:12,613 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:12,613 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:12,613 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:12,613 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,613 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:12,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,614 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:12,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:12,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:12,615 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,616 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:12,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:12,619 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:12,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:12,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:12,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,619 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:12,620 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:12,720 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:12,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:12,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:12,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:12,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,734 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:12,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:12,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:12,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:12,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,735 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,736 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:12,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:12,737 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:12,737 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,738 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,738 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,739 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:12,739 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:12,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:12,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:12,739 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:12,740 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:12,740 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:12,740 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:12,740 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:13,158 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017ac7eb4a50c04b2ead75c533ab538ecb to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ac7eb4a50c04b2ead75c533ab538ecb 2023-11-08 22:55:13,564 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/45a811e534b84025a99a2c94f8162ff5 2023-11-08 22:55:13,574 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/45a811e534b84025a99a2c94f8162ff5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5 2023-11-08 22:55:13,578 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5, entries=1, sequenceid=29, filesize=4.9 K 2023-11-08 22:55:13,578 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 838ms, sequenceid=29, compaction requested=true 2023-11-08 22:55:13,579 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:13,579 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:13,579 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:13,579 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:13,579 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,579 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:13,579 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:13,580 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,580 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:13,580 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,580 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:13,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:13,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cd5f9a8[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:13,582 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:13,582 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,582 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:13,583 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,583 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:13,583 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,583 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:13,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:13,584 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:13,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:13,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:13,586 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:13,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:13,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:13,586 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,586 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:13,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:13,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,587 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:13,587 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:13,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:13,587 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,589 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:13,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:13,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:13,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:13,590 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:13,590 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,591 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,591 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:13,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:13,591 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,591 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:13,591 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:13,691 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:13,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:13,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:13,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:13,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,702 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:13,702 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:13,702 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:13,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:13,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,703 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,704 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,704 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:13,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:13,705 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:13,705 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:13,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:13,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,706 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:13,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:13,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:13,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:13,706 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:13,707 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:13,707 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:13,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:13,707 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:13,707 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:14,126 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039f07a834f6b0459dac81a3648dd5292a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601039f07a834f6b0459dac81a3648dd5292a 2023-11-08 22:55:14,532 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/bc3c5c0a5f8d47c6b6cbf84096bff806 2023-11-08 22:55:14,540 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/bc3c5c0a5f8d47c6b6cbf84096bff806 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806 2023-11-08 22:55:14,547 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806, entries=1, sequenceid=33, filesize=4.9 K 2023-11-08 22:55:14,548 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 841ms, sequenceid=33, compaction requested=true 2023-11-08 22:55:14,548 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:14,548 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:14,548 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:14,548 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:14,549 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,549 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:14,549 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:14,550 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,551 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:14,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:14,551 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,552 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:14,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:14,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:14,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:14,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4329546d[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:14,554 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:14,554 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,555 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,555 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:14,555 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:14,555 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:14,555 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,555 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:14,556 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:14,556 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,556 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:14,556 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:14,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:14,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:14,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:14,558 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:14,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:14,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:14,558 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,558 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:14,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:14,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,559 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:14,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:14,560 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:14,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,561 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:14,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:14,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:14,563 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:14,563 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:14,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:14,564 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:14,564 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:14,564 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:14,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:14,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:14,664 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:14,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:14,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:14,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:14,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,678 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:14,679 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:14,679 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:14,679 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:14,680 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,680 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,681 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:14,681 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:14,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:14,682 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:14,682 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:14,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:14,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,683 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:14,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:14,683 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:14,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:14,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:14,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:14,684 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:14,684 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:14,684 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:14,684 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:15,101 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090789d7bea3333c425c94c3d3c4e5a66b47 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015090789d7bea3333c425c94c3d3c4e5a66b47 2023-11-08 22:55:15,508 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/7809a4e50eea40ccbe9c002bdd0be40a 2023-11-08 22:55:15,513 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/7809a4e50eea40ccbe9c002bdd0be40a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a 2023-11-08 22:55:15,516 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a, entries=1, sequenceid=37, filesize=4.9 K 2023-11-08 22:55:15,517 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 833ms, sequenceid=37, compaction requested=true 2023-11-08 22:55:15,517 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:15,517 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:15,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:15,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:15,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:15,517 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:15,518 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,518 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:15,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:15,519 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,519 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:15,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:15,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d5a4dcd[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:15,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:15,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,521 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,521 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:15,521 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:15,521 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:15,521 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,521 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:15,522 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:15,522 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,522 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:15,522 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:15,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:15,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:15,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:15,526 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:15,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:15,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:15,526 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,526 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:15,535 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,535 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,535 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:15,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:15,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:15,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:15,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:15,536 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,536 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:15,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:15,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:15,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:15,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:15,538 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:15,538 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,539 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:15,639 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:15,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:15,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:15,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:15,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,644 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:15,644 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:15,644 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-08 22:55:15,644 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-08 22:55:15,644 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,644 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,645 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,645 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:15,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:15,646 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:15,646 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:15,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:15,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,647 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,647 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-08 22:55:15,647 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:15,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-08 22:55:15,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:15,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-08 22:55:15,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-08 22:55:15,647 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:15,647 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:15,647 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. started... 2023-11-08 22:55:15,647 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 8c8a0a067b314367bbe438d0c388c44f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-08 22:55:16,068 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200f9c9217fa0d48c09a9eced170625697 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200f9c9217fa0d48c09a9eced170625697 2023-11-08 22:55:16,475 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/e76f197b6ca245258f8acd3553f39042 2023-11-08 22:55:16,487 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/e76f197b6ca245258f8acd3553f39042 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042 2023-11-08 22:55:16,492 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042, entries=1, sequenceid=41, filesize=4.9 K 2023-11-08 22:55:16,493 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8c8a0a067b314367bbe438d0c388c44f in 846ms, sequenceid=41, compaction requested=true 2023-11-08 22:55:16,493 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:16,493 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:16,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-08 22:55:16,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-08 22:55:16,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-08 22:55:16,493 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-08 22:55:16,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,495 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:16,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:16,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,495 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:16,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:16,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:16,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:16,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-08 22:55:16,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@525e1903[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:16,498 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-08 22:55:16,498 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,499 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,499 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-08 22:55:16,499 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-08 22:55:16,499 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,499 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:16,499 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:16,500 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-08 22:55:16,500 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:16,500 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,500 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-08 22:55:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:16,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:16,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:16,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-08 22:55:16,503 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-08 22:55:16,504 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:16,504 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:16,504 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,504 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:16,505 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,505 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,505 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:16,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:16,506 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,507 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:16,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,520 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,520 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,520 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,520 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:16,520 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-08 22:55:16,520 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:16,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-08 22:55:16,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:16,520 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:16,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:16,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:16,521 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:16,521 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:16,521 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:16,521 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,522 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,522 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:16,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:16,622 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:16,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:16,627 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-08 22:55:16,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:55:16,631 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:55:16,632 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:55:16,633 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484716632 2023-11-08 22:55:16,635 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-08 22:55:16,637 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-08 22:55:16,637 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:16,638 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x6cb6878a to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:55:16,643 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@261ffe5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:55:16,643 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:17,077 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103305e4eecab17412c8efb7c690e591cc2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103305e4eecab17412c8efb7c690e591cc2 2023-11-08 22:55:17,079 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:17,095 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:55:17,096 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:55:17,102 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:55:17,103 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58472, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:55:17,110 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/04622a5819f74c2198a0ea27ea22769b first=Optional[r5] last=Optional[r6] 2023-11-08 22:55:17,111 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/04622a5819f74c2198a0ea27ea22769b}] 2023-11-08 22:55:17,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/04622a5819f74c2198a0ea27ea22769b for inclusion in 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-08 22:55:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:55:17,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:17,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/04622a5819f74c2198a0ea27ea22769b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__msd0ig3vs89qvku9kkc6lt2borfvbne933djffrk2nbo4kpi8vhf81avusgihmqj/family1/04622a5819f74c2198a0ea27ea22769b 2023-11-08 22:55:17,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__msd0ig3vs89qvku9kkc6lt2borfvbne933djffrk2nbo4kpi8vhf81avusgihmqj/family1/04622a5819f74c2198a0ea27ea22769b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_ 2023-11-08 22:55:17,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__msd0ig3vs89qvku9kkc6lt2borfvbne933djffrk2nbo4kpi8vhf81avusgihmqj/family1/04622a5819f74c2198a0ea27ea22769b into 8c8a0a067b314367bbe438d0c388c44f/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_ - updating store file list. 2023-11-08 22:55:17,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_ into 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:17,126 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__msd0ig3vs89qvku9kkc6lt2borfvbne933djffrk2nbo4kpi8vhf81avusgihmqj/family1/04622a5819f74c2198a0ea27ea22769b into 8c8a0a067b314367bbe438d0c388c44f/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_) 2023-11-08 22:55:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__msd0ig3vs89qvku9kkc6lt2borfvbne933djffrk2nbo4kpi8vhf81avusgihmqj/family1/04622a5819f74c2198a0ea27ea22769b 2023-11-08 22:55:17,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-08 22:55:17,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-08 22:55:17,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 8c8a0a067b314367bbe438d0c388c44f/family1 is initiating minor compaction 2023-11-08 22:55:17,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b34c3f9; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:55:17,129 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8c8a0a067b314367bbe438d0c388c44f/family1 in testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:17,129 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp, totalSize=49.7 K 2023-11-08 22:55:17,129 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 491e5b111b304be4983983875dfd4324, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-08 22:55:17,129 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 3704ee5fb3174d62b164f56cfa7271a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-08 22:55:17,129 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 42e5f577501d44f28a0033c58d324bb6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-08 22:55:17,129 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 766889a8634e44ea9640fa0d29b364b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 0e72548e6765448dae54c31c56723f4f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 45a811e534b84025a99a2c94f8162ff5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting bc3c5c0a5f8d47c6b6cbf84096bff806, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 7809a4e50eea40ccbe9c002bdd0be40a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting e76f197b6ca245258f8acd3553f39042, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-08 22:55:17,130 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-08 22:55:17,131 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:17,131 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:17,132 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ac7eb4a50c04b2ead75c533ab538ecb to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601017ac7eb4a50c04b2ead75c533ab538ecb 2023-11-08 22:55:17,133 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601039f07a834f6b0459dac81a3648dd5292a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601039f07a834f6b0459dac81a3648dd5292a 2023-11-08 22:55:17,133 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-08 22:55:17,133 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-08 22:55:17,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:17,133 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:17,172 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8c8a0a067b314367bbe438d0c388c44f#family1#compaction#164 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-08 22:55:17,989 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/e0db56b2bca046c1acace7c0f9cb20e8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e0db56b2bca046c1acace7c0f9cb20e8 2023-11-08 22:55:17,989 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512315430d6c813a24e8b941884daa1db8bb9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512315430d6c813a24e8b941884daa1db8bb9 2023-11-08 22:55:17,992 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:17,996 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8c8a0a067b314367bbe438d0c388c44f/family1 of 8c8a0a067b314367bbe438d0c388c44f into e0db56b2bca046c1acace7c0f9cb20e8(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:17,997 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:17,997 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1699484117129; duration=0sec 2023-11-08 22:55:17,997 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:55:18,015 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/36aa3972d8b34132bc7e7bfe590ff896 first=Optional[r1] last=Optional[r4] 2023-11-08 22:55:18,016 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/36aa3972d8b34132bc7e7bfe590ff896}] 2023-11-08 22:55:18,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/36aa3972d8b34132bc7e7bfe590ff896 for inclusion in 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:18,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-08 22:55:18,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:55:18,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:18,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/36aa3972d8b34132bc7e7bfe590ff896 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gbif9i2s1b9s0vdb18oafdua6bh637357cl3m8atmbjs1m8bo4df4pitaibo1b9n/family1/36aa3972d8b34132bc7e7bfe590ff896 2023-11-08 22:55:18,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gbif9i2s1b9s0vdb18oafdua6bh637357cl3m8atmbjs1m8bo4df4pitaibo1b9n/family1/36aa3972d8b34132bc7e7bfe590ff896 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_ 2023-11-08 22:55:18,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gbif9i2s1b9s0vdb18oafdua6bh637357cl3m8atmbjs1m8bo4df4pitaibo1b9n/family1/36aa3972d8b34132bc7e7bfe590ff896 into 8c8a0a067b314367bbe438d0c388c44f/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_ - updating store file list. 2023-11-08 22:55:18,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_ into 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:18,026 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gbif9i2s1b9s0vdb18oafdua6bh637357cl3m8atmbjs1m8bo4df4pitaibo1b9n/family1/36aa3972d8b34132bc7e7bfe590ff896 into 8c8a0a067b314367bbe438d0c388c44f/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_) 2023-11-08 22:55:18,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__gbif9i2s1b9s0vdb18oafdua6bh637357cl3m8atmbjs1m8bo4df4pitaibo1b9n/family1/36aa3972d8b34132bc7e7bfe590ff896 2023-11-08 22:55:18,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-08 22:55:18,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-08 22:55:18,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(1912): 8c8a0a067b314367bbe438d0c388c44f/family1 is initiating minor compaction (all files) 2023-11-08 22:55:18,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@30f02bf6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-08 22:55:18,027 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 8c8a0a067b314367bbe438d0c388c44f/family1 in testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:18,028 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e0db56b2bca046c1acace7c0f9cb20e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp, totalSize=178.1 K 2023-11-08 22:55:18,028 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting f3428f270b3b483bac1193641dd864f2, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878850434 2023-11-08 22:55:18,029 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting e0db56b2bca046c1acace7c0f9cb20e8, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621250434 2023-11-08 22:55:18,029 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] compactions.Compactor(207): Compacting 5d68d6c433074e79b3ea20f721d6af18_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965250434 2023-11-08 22:55:18,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:18,030 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:18,032 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201637d474878264dd9975c37fc7d6451fd to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151201637d474878264dd9975c37fc7d6451fd 2023-11-08 22:55:18,033 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c05a56c3f7ae47c2aabb254c30b7ab6a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205c05a56c3f7ae47c2aabb254c30b7ab6a 2023-11-08 22:55:18,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9e02ad28c3d408db95a0a9211aeb7ab to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228f9e02ad28c3d408db95a0a9211aeb7ab 2023-11-08 22:55:18,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123198cc27d194274e13a53a4d104d95cd27 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015123198cc27d194274e13a53a4d104d95cd27 2023-11-08 22:55:18,036 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-08 22:55:18,036 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-08 22:55:18,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:18,036 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:18,045 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8c8a0a067b314367bbe438d0c388c44f#family1#compaction#165 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-11-08 22:55:18,074 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e311a163ef41499987b61c27c48d085e to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130e311a163ef41499987b61c27c48d085e 2023-11-08 22:55:18,075 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:18,093 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_] to archive 2023-11-08 22:55:18,094 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:18,095 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/491e5b111b304be4983983875dfd4324 2023-11-08 22:55:18,096 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/3704ee5fb3174d62b164f56cfa7271a8 2023-11-08 22:55:18,097 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/42e5f577501d44f28a0033c58d324bb6 2023-11-08 22:55:18,098 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/766889a8634e44ea9640fa0d29b364b0 2023-11-08 22:55:18,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/0e72548e6765448dae54c31c56723f4f 2023-11-08 22:55:18,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/45a811e534b84025a99a2c94f8162ff5 2023-11-08 22:55:18,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/bc3c5c0a5f8d47c6b6cbf84096bff806 2023-11-08 22:55:18,101 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7809a4e50eea40ccbe9c002bdd0be40a 2023-11-08 22:55:18,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e76f197b6ca245258f8acd3553f39042 2023-11-08 22:55:18,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/33810a05f5624d94ad7c2ec308d05ca4_SeqId_44_ 2023-11-08 22:55:18,105 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58eb514e35349e7b09d4e73a9a49340 first=Optional[r00] last=Optional[r8] 2023-11-08 22:55:18,106 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58eb514e35349e7b09d4e73a9a49340}] 2023-11-08 22:55:18,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58eb514e35349e7b09d4e73a9a49340 for inclusion in 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:18,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-08 22:55:18,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last= 2023-11-08 22:55:18,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:18,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/b58eb514e35349e7b09d4e73a9a49340 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91oc36b97t6ap8gdcvopkbp42ik7rnlp4ji8rqandto0kbmudrt6e4hjun42nf12/family1/b58eb514e35349e7b09d4e73a9a49340 2023-11-08 22:55:18,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91oc36b97t6ap8gdcvopkbp42ik7rnlp4ji8rqandto0kbmudrt6e4hjun42nf12/family1/b58eb514e35349e7b09d4e73a9a49340 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7938ee5c578b45b298016e29ea8cb44b_SeqId_49_ 2023-11-08 22:55:18,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91oc36b97t6ap8gdcvopkbp42ik7rnlp4ji8rqandto0kbmudrt6e4hjun42nf12/family1/b58eb514e35349e7b09d4e73a9a49340 into 8c8a0a067b314367bbe438d0c388c44f/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7938ee5c578b45b298016e29ea8cb44b_SeqId_49_ - updating store file list. 2023-11-08 22:55:18,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7938ee5c578b45b298016e29ea8cb44b_SeqId_49_ into 8c8a0a067b314367bbe438d0c388c44f/family1 2023-11-08 22:55:18,117 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91oc36b97t6ap8gdcvopkbp42ik7rnlp4ji8rqandto0kbmudrt6e4hjun42nf12/family1/b58eb514e35349e7b09d4e73a9a49340 into 8c8a0a067b314367bbe438d0c388c44f/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/7938ee5c578b45b298016e29ea8cb44b_SeqId_49_) 2023-11-08 22:55:18,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMinorCompactionWithMonthlyPolicy__91oc36b97t6ap8gdcvopkbp42ik7rnlp4ji8rqandto0kbmudrt6e4hjun42nf12/family1/b58eb514e35349e7b09d4e73a9a49340 2023-11-08 22:55:18,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:18,120 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:18,121 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200f9c9217fa0d48c09a9eced170625697 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511200f9c9217fa0d48c09a9eced170625697 2023-11-08 22:55:18,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511285aa922e52e6b4c339cc677ef876b9515 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511285aa922e52e6b4c339cc677ef876b9515 2023-11-08 22:55:18,122 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301957f33b841c4714aa2b1d931394a2a5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511301957f33b841c4714aa2b1d931394a2a5 2023-11-08 22:55:18,123 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-08 22:55:18,123 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-08 22:55:18,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:18,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:18,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-08 22:55:18,123 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-08 22:55:18,123 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:55:18,125 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-08 22:55:18,126 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4960 sec 2023-11-08 22:55:18,309 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=267 (was 250) - Thread LEAK? -, OpenFileDescriptor=691 (was 657) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=148 (was 145) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=6927 (was 5867) - AvailableMemoryMB LEAK? - 2023-11-08 22:55:18,323 INFO [Listener at localhost/37975] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=267, OpenFileDescriptor=691, MaxFileDescriptor=60000, SystemLoadAverage=148, ProcessCount=167, AvailableMemoryMB=6931 2023-11-08 22:55:18,340 DEBUG [Listener at localhost/37975] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-08 22:55:18,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10L\x9C<\x19M\xB0\xB9\xFE8/\xDAs\xF9\xD6\x80\x91"\x10O*\x5C\xFA{\x9C\x7F\xCDW?\xE0(g\xBC\xBD\xD7*\x10vj\x11j\xBB#{\x8E\x89\x87\x7F\x00F\x1F\x0B_2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-08 22:55:18,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-08 22:55:18,382 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-08 22:55:18,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-08 22:55:18,383 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-08 22:55:18,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c empty. 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2 empty. 2023-11-08 22:55:18,385 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c empty. 2023-11-08 22:55:18,386 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:18,386 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:18,386 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:18,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-08 22:55:18,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:18,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:18,796 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-08 22:55:18,799 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => d4edbc7429db0229529017da7a2dca3c, NAME => 'testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10L\x9C<\x19M\xB0\xB9\xFE8/\xDAs\xF9\xD6\x80\x91"\x10O*\x5C\xFA{\x9C\x7F\xCDW?\xE0(g\xBC\xBD\xD7*\x10vj\x11j\xBB#{\x8E\x89\x87\x7F\x00F\x1F\x0B_2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:55:18,799 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => b43c07ebfd477109566f2395761640b2, NAME => 'testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10L\x9C<\x19M\xB0\xB9\xFE8/\xDAs\xF9\xD6\x80\x91"\x10O*\x5C\xFA{\x9C\x7F\xCDW?\xE0(g\xBC\xBD\xD7*\x10vj\x11j\xBB#{\x8E\x89\x87\x7F\x00F\x1F\x0B_2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:55:18,800 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => a8c51adf26dcd72a4fc3623a2564878c, NAME => 'testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10L\x9C<\x19M\xB0\xB9\xFE8/\xDAs\xF9\xD6\x80\x91"\x10O*\x5C\xFA{\x9C\x7F\xCDW?\xE0(g\xBC\xBD\xD7*\x10vj\x11j\xBB#{\x8E\x89\x87\x7F\x00F\x1F\x0B_2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/.tmp 2023-11-08 22:55:18,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:18,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing b43c07ebfd477109566f2395761640b2, disabling compactions & flushes 2023-11-08 22:55:18,807 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:18,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:18,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. after waiting 0 ms 2023-11-08 22:55:18,807 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:18,807 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing a8c51adf26dcd72a4fc3623a2564878c, disabling compactions & flushes 2023-11-08 22:55:18,808 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. after waiting 0 ms 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:18,808 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:18,808 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:18,869 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/.tmp/family1/9339fc0f8b034548b5dd1f7fe204ae59 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/9339fc0f8b034548b5dd1f7fe204ae59 2023-11-08 22:55:18,878 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8c8a0a067b314367bbe438d0c388c44f/family1 of 8c8a0a067b314367bbe438d0c388c44f into 9339fc0f8b034548b5dd1f7fe204ae59(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:18,878 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:18,878 INFO [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1699484118027; duration=0sec 2023-11-08 22:55:18,879 DEBUG [RS:0;jenkins-hbase20:35543-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-08 22:55:18,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e0db56b2bca046c1acace7c0f9cb20e8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_] to archive 2023-11-08 22:55:18,889 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:18,891 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/f3428f270b3b483bac1193641dd864f2 2023-11-08 22:55:18,892 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e0db56b2bca046c1acace7c0f9cb20e8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/e0db56b2bca046c1acace7c0f9cb20e8 2023-11-08 22:55:18,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_ to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/family1/5d68d6c433074e79b3ea20f721d6af18_SeqId_47_ 2023-11-08 22:55:18,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:19,209 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:19,210 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing d4edbc7429db0229529017da7a2dca3c, disabling compactions & flushes 2023-11-08 22:55:19,210 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,210 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. after waiting 0 ms 2023-11-08 22:55:19,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,211 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,211 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:19,217 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-08 22:55:19,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484119219"}]},"ts":"1699484119219"} 2023-11-08 22:55:19,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699484119219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484119219"}]},"ts":"1699484119219"} 2023-11-08 22:55:19,219 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1699484119219"}]},"ts":"1699484119219"} 2023-11-08 22:55:19,221 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-08 22:55:19,222 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-08 22:55:19,222 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484119222"}]},"ts":"1699484119222"} 2023-11-08 22:55:19,224 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-08 22:55:19,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d4edbc7429db0229529017da7a2dca3c, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a8c51adf26dcd72a4fc3623a2564878c, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b43c07ebfd477109566f2395761640b2, ASSIGN}] 2023-11-08 22:55:19,230 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b43c07ebfd477109566f2395761640b2, ASSIGN 2023-11-08 22:55:19,230 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a8c51adf26dcd72a4fc3623a2564878c, ASSIGN 2023-11-08 22:55:19,230 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d4edbc7429db0229529017da7a2dca3c, ASSIGN 2023-11-08 22:55:19,231 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b43c07ebfd477109566f2395761640b2, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:55:19,231 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a8c51adf26dcd72a4fc3623a2564878c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:55:19,231 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d4edbc7429db0229529017da7a2dca3c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,35543,1699483966133; forceNewPlan=false, retain=false 2023-11-08 22:55:19,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d4edbc7429db0229529017da7a2dca3c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=b43c07ebfd477109566f2395761640b2, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119385"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484119385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484119385"}]},"ts":"1699484119385"} 2023-11-08 22:55:19,385 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119385"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484119385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484119385"}]},"ts":"1699484119385"} 2023-11-08 22:55:19,385 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=a8c51adf26dcd72a4fc3623a2564878c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,386 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699484119385"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1699484119385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1699484119385"}]},"ts":"1699484119385"} 2023-11-08 22:55:19,387 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure d4edbc7429db0229529017da7a2dca3c, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:55:19,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure b43c07ebfd477109566f2395761640b2, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:55:19,389 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure a8c51adf26dcd72a4fc3623a2564878c, server=jenkins-hbase20.apache.org,35543,1699483966133}] 2023-11-08 22:55:19,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:19,540 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:19,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b43c07ebfd477109566f2395761640b2, NAME => 'testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.', STARTKEY => '2', ENDKEY => ''} 2023-11-08 22:55:19,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:19,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,564 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,565 DEBUG [StoreOpener-b43c07ebfd477109566f2395761640b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1 2023-11-08 22:55:19,565 DEBUG [StoreOpener-b43c07ebfd477109566f2395761640b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1 2023-11-08 22:55:19,566 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43c07ebfd477109566f2395761640b2 columnFamilyName family1 2023-11-08 22:55:19,567 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] regionserver.HStore(310): Store=b43c07ebfd477109566f2395761640b2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,567 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,568 DEBUG [StoreOpener-b43c07ebfd477109566f2395761640b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2 2023-11-08 22:55:19,568 DEBUG [StoreOpener-b43c07ebfd477109566f2395761640b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2 2023-11-08 22:55:19,568 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43c07ebfd477109566f2395761640b2 columnFamilyName family2 2023-11-08 22:55:19,569 INFO [StoreOpener-b43c07ebfd477109566f2395761640b2-1] regionserver.HStore(310): Store=b43c07ebfd477109566f2395761640b2/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,571 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:55:19,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:19,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:55:19,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b43c07ebfd477109566f2395761640b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70341954, jitterRate=0.04817679524421692}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:55:19,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:19,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2., pid=121, masterSystemTime=1699484119540 2023-11-08 22:55:19,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:19,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:19,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d4edbc7429db0229529017da7a2dca3c, NAME => 'testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.', STARTKEY => '', ENDKEY => '1'} 2023-11-08 22:55:19,576 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=b43c07ebfd477109566f2395761640b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:19,576 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119575"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484119575"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484119575"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484119575"}]},"ts":"1699484119575"} 2023-11-08 22:55:19,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=119 2023-11-08 22:55:19,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure b43c07ebfd477109566f2395761640b2, server=jenkins-hbase20.apache.org,35543,1699483966133 in 189 msec 2023-11-08 22:55:19,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=b43c07ebfd477109566f2395761640b2, ASSIGN in 351 msec 2023-11-08 22:55:19,594 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,595 DEBUG [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1 2023-11-08 22:55:19,595 DEBUG [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1 2023-11-08 22:55:19,596 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4edbc7429db0229529017da7a2dca3c columnFamilyName family1 2023-11-08 22:55:19,596 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] regionserver.HStore(310): Store=d4edbc7429db0229529017da7a2dca3c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,597 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,597 DEBUG [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2 2023-11-08 22:55:19,597 DEBUG [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2 2023-11-08 22:55:19,598 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4edbc7429db0229529017da7a2dca3c columnFamilyName family2 2023-11-08 22:55:19,598 INFO [StoreOpener-d4edbc7429db0229529017da7a2dca3c-1] regionserver.HStore(310): Store=d4edbc7429db0229529017da7a2dca3c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:55:19,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:19,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:55:19,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d4edbc7429db0229529017da7a2dca3c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62015938, jitterRate=-0.07589051127433777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:55:19,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:19,603 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c., pid=120, masterSystemTime=1699484119540 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:19,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a8c51adf26dcd72a4fc3623a2564878c, NAME => 'testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.', STARTKEY => '1', ENDKEY => '2'} 2023-11-08 22:55:19,605 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=d4edbc7429db0229529017da7a2dca3c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-08 22:55:19,605 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1699484119605"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484119605"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484119605"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484119605"}]},"ts":"1699484119605"} 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=117 2023-11-08 22:55:19,608 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure d4edbc7429db0229529017da7a2dca3c, server=jenkins-hbase20.apache.org,35543,1699483966133 in 219 msec 2023-11-08 22:55:19,608 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=d4edbc7429db0229529017da7a2dca3c, ASSIGN in 381 msec 2023-11-08 22:55:19,626 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,627 DEBUG [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1 2023-11-08 22:55:19,627 DEBUG [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1 2023-11-08 22:55:19,627 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8c51adf26dcd72a4fc3623a2564878c columnFamilyName family1 2023-11-08 22:55:19,628 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] regionserver.HStore(310): Store=a8c51adf26dcd72a4fc3623a2564878c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,628 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,629 DEBUG [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2 2023-11-08 22:55:19,629 DEBUG [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2 2023-11-08 22:55:19,630 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a8c51adf26dcd72a4fc3623a2564878c columnFamilyName family2 2023-11-08 22:55:19,630 INFO [StoreOpener-a8c51adf26dcd72a4fc3623a2564878c-1] regionserver.HStore(310): Store=a8c51adf26dcd72a4fc3623a2564878c/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-08 22:55:19,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-08 22:55:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:19,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-08 22:55:19,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened a8c51adf26dcd72a4fc3623a2564878c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69791758, jitterRate=0.039978235960006714}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-08 22:55:19,634 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:19,635 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c., pid=122, masterSystemTime=1699484119540 2023-11-08 22:55:19,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:19,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:19,636 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=a8c51adf26dcd72a4fc3623a2564878c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:19,636 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1699484119636"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1699484119636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1699484119636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1699484119636"}]},"ts":"1699484119636"} 2023-11-08 22:55:19,637 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44485] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase20.apache.org,35543,1699483966133, table=testMajorCompactionFromAdmin, region=a8c51adf26dcd72a4fc3623a2564878c. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-08 22:55:19,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-11-08 22:55:19,638 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure a8c51adf26dcd72a4fc3623a2564878c, server=jenkins-hbase20.apache.org,35543,1699483966133 in 248 msec 2023-11-08 22:55:19,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-11-08 22:55:19,639 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=a8c51adf26dcd72a4fc3623a2564878c, ASSIGN in 411 msec 2023-11-08 22:55:19,640 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-08 22:55:19,640 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1699484119640"}]},"ts":"1699484119640"} 2023-11-08 22:55:19,641 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-08 22:55:19,642 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-08 22:55:19,643 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2620 sec 2023-11-08 22:55:19,712 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-08 22:55:20,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-08 22:55:20,493 INFO [Listener at localhost/37975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-08 22:55:20,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:20,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:20,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:20,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:20,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-08 22:55:20,513 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-08 22:55:20,513 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:20,513 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-08 22:55:20,513 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-08 22:55:20,514 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:20,514 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:20,516 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:20,516 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:20,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:20,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:20,517 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:20,517 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:20,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:20,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:20,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:20,519 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-08 22:55:20,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-08 22:55:20,520 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-08 22:55:20,520 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:20,520 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-08 22:55:20,520 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:20,520 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. started... 2023-11-08 22:55:20,520 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:55:20,520 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:20,520 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:20,522 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8c51adf26dcd72a4fc3623a2564878c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:55:20,522 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. started... 2023-11-08 22:55:20,521 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:20,523 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. started... 2023-11-08 22:55:20,523 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d4edbc7429db0229529017da7a2dca3c 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:55:20,524 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b43c07ebfd477109566f2395761640b2 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-08 22:55:20,973 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108d2d58ee1bf8e4a8d9f374e770ac6560b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108d2d58ee1bf8e4a8d9f374e770ac6560b 2023-11-08 22:55:20,981 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110875ff406b0eaf45ae93d6e331006571b4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110875ff406b0eaf45ae93d6e331006571b4 2023-11-08 22:55:20,981 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108884e7de68bfe4e9faee60746b9a51ba8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231108884e7de68bfe4e9faee60746b9a51ba8 2023-11-08 22:55:21,000 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/5d6ee351f8914d7bb1517caf1dc52d38 2023-11-08 22:55:21,393 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/6159b409ca5a44a68ed8e6742efd3111 2023-11-08 22:55:21,401 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/de99a94c28524dd98164b96dab487ac9 2023-11-08 22:55:21,428 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108216a3dd35a0544c0a5c01468dc3e1b63 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231108216a3dd35a0544c0a5c01468dc3e1b63 2023-11-08 22:55:21,433 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110879a51927d830472aa3c4712f4ee78f6f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110879a51927d830472aa3c4712f4ee78f6f 2023-11-08 22:55:21,833 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110871a4b4f683a9419ca4033bf92b58d3df to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110871a4b4f683a9419ca4033bf92b58d3df 2023-11-08 22:55:21,834 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/de23eeab87f84640bb45f7c49ded7bd8 2023-11-08 22:55:21,837 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/2fadea4061034979868723e1e55b2631 2023-11-08 22:55:21,839 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/5d6ee351f8914d7bb1517caf1dc52d38 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38 2023-11-08 22:55:21,842 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/de99a94c28524dd98164b96dab487ac9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9 2023-11-08 22:55:21,861 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38, entries=4, sequenceid=5, filesize=5.5 K 2023-11-08 22:55:21,862 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9, entries=4, sequenceid=5, filesize=5.5 K 2023-11-08 22:55:21,862 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/de23eeab87f84640bb45f7c49ded7bd8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8 2023-11-08 22:55:21,862 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/2fadea4061034979868723e1e55b2631 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631 2023-11-08 22:55:21,865 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:55:21,865 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:55:21,866 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b43c07ebfd477109566f2395761640b2 in 1342ms, sequenceid=5, compaction requested=false 2023-11-08 22:55:21,866 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a8c51adf26dcd72a4fc3623a2564878c in 1344ms, sequenceid=5, compaction requested=false 2023-11-08 22:55:21,866 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:21,866 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:21,866 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:21,866 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:21,866 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:55:21,867 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:55:22,238 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/16c8a1bbb4604e7eaea76441e3653f60 2023-11-08 22:55:22,246 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/6159b409ca5a44a68ed8e6742efd3111 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111 2023-11-08 22:55:22,267 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111, entries=4, sequenceid=5, filesize=5.5 K 2023-11-08 22:55:22,268 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/16c8a1bbb4604e7eaea76441e3653f60 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60 2023-11-08 22:55:22,271 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60, entries=2, sequenceid=5, filesize=5.1 K 2023-11-08 22:55:22,272 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d4edbc7429db0229529017da7a2dca3c in 1749ms, sequenceid=5, compaction requested=false 2023-11-08 22:55:22,272 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:22,272 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:22,272 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:55:22,272 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:55:22,272 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,272 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-08 22:55:22,272 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-08 22:55:22,273 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,273 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:22,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:22,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:22,274 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:22,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-08 22:55:22,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2135a259[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:22,275 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-08 22:55:22,275 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,276 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-08 22:55:22,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-08 22:55:22,276 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:22,276 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,276 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:22,277 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-08 22:55:22,277 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:22,277 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,277 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:22,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:22,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-08 22:55:22,279 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-08 22:55:22,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:22,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:22,279 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-08 22:55:22,279 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:22,280 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,280 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:22,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,280 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:22,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:22,280 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,281 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:22,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,282 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:22,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-08 22:55:22,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:22,283 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:22,283 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:22,383 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:22,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:22,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:22,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:22,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:22,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:22,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:22,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-08 22:55:22,399 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-08 22:55:22,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:22,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-08 22:55:22,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-08 22:55:22,399 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,400 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:22,401 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:22,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:22,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:22,401 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:22,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:22,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:22,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:22,403 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-08 22:55:22,403 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-08 22:55:22,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-08 22:55:22,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-08 22:55:22,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:22,403 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. started... 2023-11-08 22:55:22,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:55:22,404 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. started... 2023-11-08 22:55:22,404 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. started... 2023-11-08 22:55:22,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b43c07ebfd477109566f2395761640b2 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:55:22,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8c51adf26dcd72a4fc3623a2564878c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:55:22,404 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d4edbc7429db0229529017da7a2dca3c 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-08 22:55:22,845 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108a76f5c3ab2844358a4bb733f1ab1bfdf to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108a76f5c3ab2844358a4bb733f1ab1bfdf 2023-11-08 22:55:22,845 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110841d6f62146b248559a187c65188256fe to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110841d6f62146b248559a187c65188256fe 2023-11-08 22:55:22,850 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311080679b07e64d14026b2584b59adbcdb52 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311080679b07e64d14026b2584b59adbcdb52 2023-11-08 22:55:22,859 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/5f67aac1aea8409f9ff6a2315478b597 2023-11-08 22:55:23,263 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/7903458a15724d37b985e732e088e7eb 2023-11-08 22:55:23,266 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/8d6f42aeddab4c1fbb05460b19c246a9 2023-11-08 22:55:23,300 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110833e3fe932d55459780ab9126a5a5658b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110833e3fe932d55459780ab9126a5a5658b 2023-11-08 22:55:23,306 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/b2e91f304bdf45c7a4818b198fee5a50 2023-11-08 22:55:23,310 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/5f67aac1aea8409f9ff6a2315478b597 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597 2023-11-08 22:55:23,334 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597, entries=4, sequenceid=9, filesize=5.5 K 2023-11-08 22:55:23,335 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/b2e91f304bdf45c7a4818b198fee5a50 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50 2023-11-08 22:55:23,339 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:55:23,340 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b43c07ebfd477109566f2395761640b2 in 936ms, sequenceid=9, compaction requested=false 2023-11-08 22:55:23,340 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:23,340 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:23,340 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:55:23,693 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110899035e694b7948b8acf1b74be2d887d5 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110899035e694b7948b8acf1b74be2d887d5 2023-11-08 22:55:23,695 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311084c394255f156463b9fc1e99a5af34286 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311084c394255f156463b9fc1e99a5af34286 2023-11-08 22:55:23,700 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/c3e45c0c86c445639f754a3835d563ca 2023-11-08 22:55:23,700 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/600fb170abca4b388e3b64753c05a0f8 2023-11-08 22:55:23,704 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/7903458a15724d37b985e732e088e7eb as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb 2023-11-08 22:55:23,704 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/8d6f42aeddab4c1fbb05460b19c246a9 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9 2023-11-08 22:55:23,724 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9, entries=4, sequenceid=9, filesize=5.5 K 2023-11-08 22:55:23,724 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb, entries=4, sequenceid=9, filesize=5.5 K 2023-11-08 22:55:23,725 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/c3e45c0c86c445639f754a3835d563ca as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca 2023-11-08 22:55:23,725 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/600fb170abca4b388e3b64753c05a0f8 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8 2023-11-08 22:55:23,728 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:55:23,728 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca, entries=2, sequenceid=9, filesize=5.1 K 2023-11-08 22:55:23,729 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a8c51adf26dcd72a4fc3623a2564878c in 1325ms, sequenceid=9, compaction requested=false 2023-11-08 22:55:23,729 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d4edbc7429db0229529017da7a2dca3c in 1325ms, sequenceid=9, compaction requested=false 2023-11-08 22:55:23,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:23,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:23,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:23,729 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:23,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:55:23,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:55:23,729 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:55:23,730 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,730 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-08 22:55:23,730 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-08 22:55:23,731 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:23,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,731 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:23,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-08 22:55:23,732 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2836002e[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:23,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-08 22:55:23,732 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,733 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,733 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-08 22:55:23,733 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,733 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:23,733 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-08 22:55:23,733 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:23,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-08 22:55:23,734 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:23,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:23,734 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-08 22:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:23,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:23,736 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-08 22:55:23,736 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-08 22:55:23,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:23,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:23,736 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-08 22:55:23,736 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:23,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,737 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:23,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:23,737 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,738 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:23,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:23,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:23,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:23,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:23,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-08 22:55:23,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:23,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-08 22:55:23,740 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:23,740 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:23,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:23,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:23,841 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:23,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:23,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:23,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:23,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:23,845 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:23,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:23,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-08 22:55:23,847 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-08 22:55:23,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:23,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-08 22:55:23,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-08 22:55:23,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,847 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:23,848 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,848 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:23,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:23,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:23,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:23,849 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-08 22:55:23,849 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-08 22:55:23,849 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-08 22:55:23,849 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-08 22:55:23,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:23,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:23,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:55:23,850 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. started... 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. started... 2023-11-08 22:55:23,850 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. started... 2023-11-08 22:55:23,850 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8c51adf26dcd72a4fc3623a2564878c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:55:23,850 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b43c07ebfd477109566f2395761640b2 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:55:23,850 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d4edbc7429db0229529017da7a2dca3c 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-08 22:55:24,292 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311082b0c1c84877e49cb96997c19bc3ff5b3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311082b0c1c84877e49cb96997c19bc3ff5b3 2023-11-08 22:55:24,301 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311085cc4f773eea7451d83d6f18794ae1c45 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311085cc4f773eea7451d83d6f18794ae1c45 2023-11-08 22:55:24,301 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110891c6ed3d9d6d4530a5bc57c9067be1c3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110891c6ed3d9d6d4530a5bc57c9067be1c3 2023-11-08 22:55:24,327 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:55:24,328 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6cb6878a to 127.0.0.1:56299 2023-11-08 22:55:24,328 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:24,328 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:55:24,328 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35a032c1 to 127.0.0.1:56299 2023-11-08 22:55:24,328 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:24,707 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/0b1deb11e05e4f3caa00a923721e81c2 2023-11-08 22:55:24,734 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/1604d72d20c24732aba48b117b70a90b 2023-11-08 22:55:24,734 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/c46db06311944f85b226bfbdb2624011 2023-11-08 22:55:24,763 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110846bd36d4560e4cec8aa31ddbee972354 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110846bd36d4560e4cec8aa31ddbee972354 2023-11-08 22:55:24,781 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311088eb28a6e5802448aad7d7720228d8f81 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311088eb28a6e5802448aad7d7720228d8f81 2023-11-08 22:55:25,097 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-08 22:55:25,176 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/98592589ba3540b0bcd9e40a345ab027 2023-11-08 22:55:25,181 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/0b1deb11e05e4f3caa00a923721e81c2 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2 2023-11-08 22:55:25,183 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311089acdc340b89b42e7915a3b5d3029bd0f to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311089acdc340b89b42e7915a3b5d3029bd0f 2023-11-08 22:55:25,193 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/a94f11aeb8584553a8ff844a2137fb93 2023-11-08 22:55:25,194 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/f387b728caf7406aa7bb227964474a08 2023-11-08 22:55:25,199 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/1604d72d20c24732aba48b117b70a90b as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b 2023-11-08 22:55:25,201 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/c46db06311944f85b226bfbdb2624011 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011 2023-11-08 22:55:25,207 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2, entries=4, sequenceid=13, filesize=5.5 K 2023-11-08 22:55:25,208 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/98592589ba3540b0bcd9e40a345ab027 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027 2023-11-08 22:55:25,220 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:55:25,221 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d4edbc7429db0229529017da7a2dca3c in 1371ms, sequenceid=13, compaction requested=true 2023-11-08 22:55:25,221 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:25,221 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:25,221 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:55:25,230 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b, entries=4, sequenceid=13, filesize=5.5 K 2023-11-08 22:55:25,231 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/f387b728caf7406aa7bb227964474a08 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08 2023-11-08 22:55:25,238 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011, entries=4, sequenceid=13, filesize=5.5 K 2023-11-08 22:55:25,239 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/a94f11aeb8584553a8ff844a2137fb93 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93 2023-11-08 22:55:25,244 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:55:25,244 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b43c07ebfd477109566f2395761640b2 in 1394ms, sequenceid=13, compaction requested=true 2023-11-08 22:55:25,245 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:25,245 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:25,245 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:55:25,248 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93, entries=2, sequenceid=13, filesize=5.1 K 2023-11-08 22:55:25,249 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a8c51adf26dcd72a4fc3623a2564878c in 1399ms, sequenceid=13, compaction requested=true 2023-11-08 22:55:25,249 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:25,249 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:55:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:55:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-08 22:55:25,249 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-08 22:55:25,250 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,250 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:25,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-08 22:55:25,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@674d14c0[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:25,251 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-08 22:55:25,252 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,252 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-08 22:55:25,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-08 22:55:25,252 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:25,252 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,252 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:25,253 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-08 22:55:25,253 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:25,253 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-08 22:55:25,253 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:25,257 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-08 22:55:25,257 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-08 22:55:25,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:25,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:25,257 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-08 22:55:25,257 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:25,270 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,270 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:25,270 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:25,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:25,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:25,272 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,273 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:25,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:25,278 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:25,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-08 22:55:25,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,278 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:25,279 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:25,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:25,379 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:25,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:25,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:25,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:25,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. with WAL disabled. Data may be lost in the event of a crash. 2023-11-08 22:55:25,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:25,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:25,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-08 22:55:25,385 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-08 22:55:25,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:25,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-08 22:55:25,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-08 22:55:25,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,385 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:25,386 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,386 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:25,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:25,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:25,386 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:25,387 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:25,387 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:25,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-08 22:55:25,388 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-08 22:55:25,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-08 22:55:25,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-08 22:55:25,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:25,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:25,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:55:25,388 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. started... 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. started... 2023-11-08 22:55:25,388 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. started... 2023-11-08 22:55:25,388 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8c51adf26dcd72a4fc3623a2564878c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:55:25,388 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b43c07ebfd477109566f2395761640b2 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:55:25,388 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d4edbc7429db0229529017da7a2dca3c 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-08 22:55:25,848 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311084ecdfc159daa4053a25370384f78c199 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311084ecdfc159daa4053a25370384f78c199 2023-11-08 22:55:25,852 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108726d90c2e52b4204955cf3e663c3b390 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108726d90c2e52b4204955cf3e663c3b390 2023-11-08 22:55:25,857 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311086157befdb61640efa6899e47e5b7a991 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311086157befdb61640efa6899e47e5b7a991 2023-11-08 22:55:25,880 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/12f35ce7735f42ed9d7ceccfbe01f492 2023-11-08 22:55:26,278 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/ed385af89b7b437bae56fa1d8fdc177a 2023-11-08 22:55:26,278 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/393bf31af89941a9bf5945d2f7314753 2023-11-08 22:55:26,323 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311089ce6c4b408864176a47796187ffa2c40 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311089ce6c4b408864176a47796187ffa2c40 2023-11-08 22:55:26,717 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110840bf763e0370430eb6b1e14e0c991f98 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110840bf763e0370430eb6b1e14e0c991f98 2023-11-08 22:55:26,717 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231108c2c0e8d5f689457b829348838b4c5773 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231108c2c0e8d5f689457b829348838b4c5773 2023-11-08 22:55:26,729 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/f2be32c2a6884b5aac7e8750cc4acf9d 2023-11-08 22:55:26,734 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/12f35ce7735f42ed9d7ceccfbe01f492 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492 2023-11-08 22:55:26,759 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492, entries=4, sequenceid=17, filesize=5.5 K 2023-11-08 22:55:26,760 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/f2be32c2a6884b5aac7e8750cc4acf9d as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d 2023-11-08 22:55:26,763 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:55:26,763 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a8c51adf26dcd72a4fc3623a2564878c in 1375ms, sequenceid=17, compaction requested=true 2023-11-08 22:55:26,763 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:26,763 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:26,763 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:55:27,122 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/e124058078354f538ec7b14a3b975859 2023-11-08 22:55:27,123 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/5cd81f8b3c9742339cd9dade9d72c661 2023-11-08 22:55:27,126 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/393bf31af89941a9bf5945d2f7314753 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753 2023-11-08 22:55:27,126 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/ed385af89b7b437bae56fa1d8fdc177a as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a 2023-11-08 22:55:27,155 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a, entries=4, sequenceid=17, filesize=5.5 K 2023-11-08 22:55:27,155 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753, entries=4, sequenceid=17, filesize=5.5 K 2023-11-08 22:55:27,156 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/5cd81f8b3c9742339cd9dade9d72c661 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661 2023-11-08 22:55:27,156 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/e124058078354f538ec7b14a3b975859 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859 2023-11-08 22:55:27,159 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:55:27,159 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661, entries=2, sequenceid=17, filesize=5.1 K 2023-11-08 22:55:27,160 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d4edbc7429db0229529017da7a2dca3c in 1772ms, sequenceid=17, compaction requested=true 2023-11-08 22:55:27,160 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b43c07ebfd477109566f2395761640b2 in 1772ms, sequenceid=17, compaction requested=true 2023-11-08 22:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:27,160 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-08 22:55:27,160 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-08 22:55:27,163 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,163 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:27,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:27,163 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,163 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:27,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:27,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:27,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:27,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-08 22:55:27,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45f98f2b[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:27,164 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-08 22:55:27,164 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,165 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,165 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-08 22:55:27,165 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-08 22:55:27,165 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:27,165 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,165 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:27,166 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,166 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:27,166 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:27,166 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:27,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:27,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:27,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-08 22:55:27,168 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-08 22:55:27,168 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:27,168 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:27,168 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-08 22:55:27,168 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:27,169 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:27,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:27,169 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:27,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,170 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:27,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:27,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:27,172 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:27,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:27,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-08 22:55:27,172 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:27,172 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,172 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:27,172 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:27,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:27,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:27,272 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:27,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:27,282 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:27,290 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:27,297 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:27,298 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:27,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-11-08 22:55:27,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-08 22:55:27,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-08 22:55:27,377 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-08 22:55:27,377 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:27,377 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-08 22:55:27,377 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-08 22:55:27,377 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,377 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:27,378 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,378 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:27,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:27,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:27,378 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:27,378 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-08 22:55:27,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:27,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:27,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-08 22:55:27,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:27,379 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-08 22:55:27,379 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-08 22:55:27,379 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-08 22:55:27,379 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-08 22:55:27,379 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-08 22:55:27,379 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. started... 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. started... 2023-11-08 22:55:27,381 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing a8c51adf26dcd72a4fc3623a2564878c 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:55:27,381 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing d4edbc7429db0229529017da7a2dca3c 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:55:27,381 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-08 22:55:27,381 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:27,381 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. started... 2023-11-08 22:55:27,381 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing b43c07ebfd477109566f2395761640b2 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-08 22:55:28,219 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/41f56e7c6d6c4146b11eee2502bb35ef 2023-11-08 22:55:28,225 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/99d43d146d8748cf96731b1774f20332 2023-11-08 22:55:28,229 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/2e38e33d291646f693b1ce7dd3144685 2023-11-08 22:55:28,245 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41f56e7c6d6c4146b11eee2502bb35ef 2023-11-08 22:55:28,246 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99d43d146d8748cf96731b1774f20332 2023-11-08 22:55:28,254 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e38e33d291646f693b1ce7dd3144685 2023-11-08 22:55:29,061 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/6398cd2748414644addae3fe4f60362c 2023-11-08 22:55:29,062 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/ec56e22eaff74ab08242afac57d9ed66 2023-11-08 22:55:29,065 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/98ac574652cb4665aa1d53642043a065 2023-11-08 22:55:29,066 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec56e22eaff74ab08242afac57d9ed66 2023-11-08 22:55:29,066 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6398cd2748414644addae3fe4f60362c 2023-11-08 22:55:29,067 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/41f56e7c6d6c4146b11eee2502bb35ef as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef 2023-11-08 22:55:29,067 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/99d43d146d8748cf96731b1774f20332 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332 2023-11-08 22:55:29,069 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98ac574652cb4665aa1d53642043a065 2023-11-08 22:55:29,070 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/2e38e33d291646f693b1ce7dd3144685 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685 2023-11-08 22:55:29,092 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 41f56e7c6d6c4146b11eee2502bb35ef 2023-11-08 22:55:29,092 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef, entries=3, sequenceid=23, filesize=5.2 K 2023-11-08 22:55:29,093 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/6398cd2748414644addae3fe4f60362c as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c 2023-11-08 22:55:29,099 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99d43d146d8748cf96731b1774f20332 2023-11-08 22:55:29,099 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332, entries=3, sequenceid=23, filesize=5.2 K 2023-11-08 22:55:29,100 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/ec56e22eaff74ab08242afac57d9ed66 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66 2023-11-08 22:55:29,102 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6398cd2748414644addae3fe4f60362c 2023-11-08 22:55:29,103 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:55:29,103 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a8c51adf26dcd72a4fc3623a2564878c in 1722ms, sequenceid=23, compaction requested=true 2023-11-08 22:55:29,103 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:29,103 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:29,104 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-08 22:55:29,104 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e38e33d291646f693b1ce7dd3144685 2023-11-08 22:55:29,104 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685, entries=3, sequenceid=23, filesize=5.2 K 2023-11-08 22:55:29,105 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/98ac574652cb4665aa1d53642043a065 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065 2023-11-08 22:55:29,114 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ec56e22eaff74ab08242afac57d9ed66 2023-11-08 22:55:29,114 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:55:29,115 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d4edbc7429db0229529017da7a2dca3c in 1734ms, sequenceid=23, compaction requested=true 2023-11-08 22:55:29,115 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:29,115 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:29,115 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-08 22:55:29,120 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 98ac574652cb4665aa1d53642043a065 2023-11-08 22:55:29,120 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065, entries=1, sequenceid=23, filesize=5.0 K 2023-11-08 22:55:29,121 INFO [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b43c07ebfd477109566f2395761640b2 in 1740ms, sequenceid=23, compaction requested=true 2023-11-08 22:55:29,121 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:29,121 DEBUG [rs(jenkins-hbase20.apache.org,35543,1699483966133)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:29,121 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-08 22:55:29,121 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-08 22:55:29,121 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,121 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-08 22:55:29,121 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-08 22:55:29,122 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,122 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:29,123 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,123 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:29,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:29,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,35543,1699483966133' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-08 22:55:29,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49d2caa7[Count = 0] remaining members to acquire global barrier 2023-11-08 22:55:29,124 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-08 22:55:29,124 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,125 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,125 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-08 22:55:29,125 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-08 22:55:29,125 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,35543,1699483966133' in zk 2023-11-08 22:55:29,125 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,125 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-08 22:55:29,126 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-08 22:55:29,126 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:29,126 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,126 DEBUG [member: 'jenkins-hbase20.apache.org,35543,1699483966133' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-08 22:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:29,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,35543,1699483966133': 2023-11-08 22:55:29,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,35543,1699483966133' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-08 22:55:29,128 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-08 22:55:29,128 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-08 22:55:29,128 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-08 22:55:29,128 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-08 22:55:29,128 INFO [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-08 22:55:29,129 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-08 22:55:29,129 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,129 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-08 22:55:29,129 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:29,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:29,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-08 22:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,131 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-08 22:55:29,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-08 22:55:29,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-08 22:55:29,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-08 22:55:29,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-08 22:55:29,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-08 22:55:29,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-08 22:55:29,133 DEBUG [(jenkins-hbase20.apache.org,44485,1699483965103)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-08 22:55:29,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-08 22:55:29,133 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-08 22:55:29,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-08 22:55:29,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-08 22:55:29,233 DEBUG [Listener at localhost/37975] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-08 22:55:29,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44485] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-08 22:55:29,234 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:29,235 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): a8c51adf26dcd72a4fc3623a2564878c/family1 is initiating major compaction (all files) 2023-11-08 22:55:29,235 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:29,235 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:29,235 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of a8c51adf26dcd72a4fc3623a2564878c/family1 in testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:29,235 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp, totalSize=27.1 K 2023-11-08 22:55:29,236 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting de99a94c28524dd98164b96dab487ac9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120506 2023-11-08 22:55:29,236 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 8d6f42aeddab4c1fbb05460b19c246a9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122388 2023-11-08 22:55:29,236 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting c46db06311944f85b226bfbdb2624011, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123843 2023-11-08 22:55:29,237 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 12f35ce7735f42ed9d7ceccfbe01f492, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:29,237 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 41f56e7c6d6c4146b11eee2502bb35ef, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:29,247 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): a8c51adf26dcd72a4fc3623a2564878c#family1#compaction#196 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:29,685 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del 2023-11-08 22:55:29,685 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del 2023-11-08 22:55:30,536 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c4810219b4b4ecd86ef672a04af42fc 2023-11-08 22:55:30,537 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family1/6c4810219b4b4ecd86ef672a04af42fc as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/6c4810219b4b4ecd86ef672a04af42fc 2023-11-08 22:55:30,554 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c4810219b4b4ecd86ef672a04af42fc 2023-11-08 22:55:30,555 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a8c51adf26dcd72a4fc3623a2564878c/family1 of a8c51adf26dcd72a4fc3623a2564878c into 6c4810219b4b4ecd86ef672a04af42fc(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:55:30,555 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:30,555 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:30,555 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): a8c51adf26dcd72a4fc3623a2564878c/family2 is initiating major compaction (all files) 2023-11-08 22:55:30,555 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:30,556 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:30,557 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of a8c51adf26dcd72a4fc3623a2564878c/family2 in testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:30,557 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp, totalSize=25.4 K 2023-11-08 22:55:30,557 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 2fadea4061034979868723e1e55b2631, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120506 2023-11-08 22:55:30,558 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting c3e45c0c86c445639f754a3835d563ca, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122388 2023-11-08 22:55:30,558 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting a94f11aeb8584553a8ff844a2137fb93, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123843 2023-11-08 22:55:30,558 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f2be32c2a6884b5aac7e8750cc4acf9d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:30,559 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 6398cd2748414644addae3fe4f60362c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:30,566 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): a8c51adf26dcd72a4fc3623a2564878c#family2#compaction#197 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:30,573 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023110842ecceec86064afe96fbfdd2c59c4a08_del 2023-11-08 22:55:30,573 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023110842ecceec86064afe96fbfdd2c59c4a08_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023110842ecceec86064afe96fbfdd2c59c4a08_del 2023-11-08 22:55:30,585 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bfa1b6549674cd583ccfbc91bf987e4 2023-11-08 22:55:30,586 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/.tmp/family2/9bfa1b6549674cd583ccfbc91bf987e4 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/9bfa1b6549674cd583ccfbc91bf987e4 2023-11-08 22:55:30,588 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bfa1b6549674cd583ccfbc91bf987e4 2023-11-08 22:55:30,589 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a8c51adf26dcd72a4fc3623a2564878c/family2 of a8c51adf26dcd72a4fc3623a2564878c into 9bfa1b6549674cd583ccfbc91bf987e4(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:30,589 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:30,589 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:30,589 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): d4edbc7429db0229529017da7a2dca3c/family1 is initiating major compaction (all files) 2023-11-08 22:55:30,589 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef] to archive 2023-11-08 22:55:30,590 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:30,590 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:30,590 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of d4edbc7429db0229529017da7a2dca3c/family1 in testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:30,590 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:30,590 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp, totalSize=27.1 K 2023-11-08 22:55:30,590 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 6159b409ca5a44a68ed8e6742efd3111, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120505 2023-11-08 22:55:30,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 7903458a15724d37b985e732e088e7eb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122388 2023-11-08 22:55:30,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 0b1deb11e05e4f3caa00a923721e81c2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123842 2023-11-08 22:55:30,591 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/de99a94c28524dd98164b96dab487ac9 2023-11-08 22:55:30,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 393bf31af89941a9bf5945d2f7314753, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:30,591 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 99d43d146d8748cf96731b1774f20332, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:30,592 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8d6f42aeddab4c1fbb05460b19c246a9 2023-11-08 22:55:30,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/c46db06311944f85b226bfbdb2624011 2023-11-08 22:55:30,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/12f35ce7735f42ed9d7ceccfbe01f492 2023-11-08 22:55:30,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/41f56e7c6d6c4146b11eee2502bb35ef 2023-11-08 22:55:30,596 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c] to archive 2023-11-08 22:55:30,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:30,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/2fadea4061034979868723e1e55b2631 2023-11-08 22:55:30,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/c3e45c0c86c445639f754a3835d563ca 2023-11-08 22:55:30,601 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): d4edbc7429db0229529017da7a2dca3c#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:30,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/a94f11aeb8584553a8ff844a2137fb93 2023-11-08 22:55:30,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/f2be32c2a6884b5aac7e8750cc4acf9d 2023-11-08 22:55:30,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family2/6398cd2748414644addae3fe4f60362c 2023-11-08 22:55:31,037 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del 2023-11-08 22:55:31,037 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del 2023-11-08 22:55:31,084 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a77c11786bc84ce19755703b2ac4ec23 2023-11-08 22:55:31,085 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family1/a77c11786bc84ce19755703b2ac4ec23 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/a77c11786bc84ce19755703b2ac4ec23 2023-11-08 22:55:31,105 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a77c11786bc84ce19755703b2ac4ec23 2023-11-08 22:55:31,106 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4edbc7429db0229529017da7a2dca3c/family1 of d4edbc7429db0229529017da7a2dca3c into a77c11786bc84ce19755703b2ac4ec23(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:31,106 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:31,106 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:31,106 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): d4edbc7429db0229529017da7a2dca3c/family2 is initiating major compaction (all files) 2023-11-08 22:55:31,106 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:31,106 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:31,107 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of d4edbc7429db0229529017da7a2dca3c/family2 in testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:31,107 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp, totalSize=25.4 K 2023-11-08 22:55:31,108 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 16c8a1bbb4604e7eaea76441e3653f60, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120505 2023-11-08 22:55:31,108 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 600fb170abca4b388e3b64753c05a0f8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122388 2023-11-08 22:55:31,108 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 98592589ba3540b0bcd9e40a345ab027, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123842 2023-11-08 22:55:31,109 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting e124058078354f538ec7b14a3b975859, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:31,109 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting ec56e22eaff74ab08242afac57d9ed66, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:31,116 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): d4edbc7429db0229529017da7a2dca3c#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:31,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332] to archive 2023-11-08 22:55:31,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:31,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/6159b409ca5a44a68ed8e6742efd3111 2023-11-08 22:55:31,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/7903458a15724d37b985e732e088e7eb 2023-11-08 22:55:31,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/0b1deb11e05e4f3caa00a923721e81c2 2023-11-08 22:55:31,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/393bf31af89941a9bf5945d2f7314753 2023-11-08 22:55:31,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/99d43d146d8748cf96731b1774f20332 2023-11-08 22:55:31,523 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023110876ba14137101449a84ffaff5e1e44db0_del 2023-11-08 22:55:31,523 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110876ba14137101449a84ffaff5e1e44db0_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023110876ba14137101449a84ffaff5e1e44db0_del 2023-11-08 22:55:31,936 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eeeebff113fd47bba5537a78f325967e 2023-11-08 22:55:31,937 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/.tmp/family2/eeeebff113fd47bba5537a78f325967e as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/eeeebff113fd47bba5537a78f325967e 2023-11-08 22:55:31,940 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eeeebff113fd47bba5537a78f325967e 2023-11-08 22:55:31,941 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4edbc7429db0229529017da7a2dca3c/family2 of d4edbc7429db0229529017da7a2dca3c into eeeebff113fd47bba5537a78f325967e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:31,941 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:31,941 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:31,941 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): b43c07ebfd477109566f2395761640b2/family1 is initiating major compaction (all files) 2023-11-08 22:55:31,941 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:31,941 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:31,941 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of b43c07ebfd477109566f2395761640b2/family1 in testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:31,941 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp, totalSize=27.1 K 2023-11-08 22:55:31,942 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5d6ee351f8914d7bb1517caf1dc52d38, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120506 2023-11-08 22:55:31,942 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5f67aac1aea8409f9ff6a2315478b597, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122389 2023-11-08 22:55:31,942 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 1604d72d20c24732aba48b117b70a90b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123843 2023-11-08 22:55:31,942 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting ed385af89b7b437bae56fa1d8fdc177a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:31,943 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 2e38e33d291646f693b1ce7dd3144685, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:31,949 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): b43c07ebfd477109566f2395761640b2#family1#compaction#200 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:31,989 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66] to archive 2023-11-08 22:55:31,990 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:31,992 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/16c8a1bbb4604e7eaea76441e3653f60 2023-11-08 22:55:31,993 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/600fb170abca4b388e3b64753c05a0f8 2023-11-08 22:55:31,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/98592589ba3540b0bcd9e40a345ab027 2023-11-08 22:55:31,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/e124058078354f538ec7b14a3b975859 2023-11-08 22:55:31,996 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family2/ec56e22eaff74ab08242afac57d9ed66 2023-11-08 22:55:32,397 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del 2023-11-08 22:55:32,397 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del 2023-11-08 22:55:33,249 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26dada79fd224b5895ababeaa73570fc 2023-11-08 22:55:33,250 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family1/26dada79fd224b5895ababeaa73570fc as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/26dada79fd224b5895ababeaa73570fc 2023-11-08 22:55:33,276 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26dada79fd224b5895ababeaa73570fc 2023-11-08 22:55:33,277 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b43c07ebfd477109566f2395761640b2/family1 of b43c07ebfd477109566f2395761640b2 into 26dada79fd224b5895ababeaa73570fc(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-08 22:55:33,277 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:33,277 DEBUG [Listener at localhost/37975] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-08 22:55:33,277 DEBUG [Listener at localhost/37975] regionserver.HStore(1912): b43c07ebfd477109566f2395761640b2/family2 is initiating major compaction (all files) 2023-11-08 22:55:33,277 INFO [Listener at localhost/37975] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-08 22:55:33,277 INFO [Listener at localhost/37975] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-08 22:55:33,278 INFO [Listener at localhost/37975] regionserver.HRegion(2259): Starting compaction of b43c07ebfd477109566f2395761640b2/family2 in testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:33,278 INFO [Listener at localhost/37975] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065] into tmpdir=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp, totalSize=25.4 K 2023-11-08 22:55:33,279 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting de23eeab87f84640bb45f7c49ded7bd8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1699484120506 2023-11-08 22:55:33,279 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting b2e91f304bdf45c7a4818b198fee5a50, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1699484122389 2023-11-08 22:55:33,279 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting f387b728caf7406aa7bb227964474a08, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1699484123843 2023-11-08 22:55:33,280 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 5cd81f8b3c9742339cd9dade9d72c661, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1699484125380 2023-11-08 22:55:33,280 DEBUG [Listener at localhost/37975] compactions.Compactor(207): Compacting 98ac574652cb4665aa1d53642043a065, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-08 22:55:33,289 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685] to archive 2023-11-08 22:55:33,291 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:33,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5d6ee351f8914d7bb1517caf1dc52d38 2023-11-08 22:55:33,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/5f67aac1aea8409f9ff6a2315478b597 2023-11-08 22:55:33,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/1604d72d20c24732aba48b117b70a90b 2023-11-08 22:55:33,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/ed385af89b7b437bae56fa1d8fdc177a 2023-11-08 22:55:33,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/2e38e33d291646f693b1ce7dd3144685 2023-11-08 22:55:33,306 INFO [Listener at localhost/37975] throttle.PressureAwareThroughputController(145): b43c07ebfd477109566f2395761640b2#family2#compaction#201 average throughput is 0.05 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-08 22:55:33,721 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023110843db781e3ba94fa5aa646168d9fcdb80_del 2023-11-08 22:55:33,721 INFO [Listener at localhost/37975] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023110843db781e3ba94fa5aa646168d9fcdb80_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023110843db781e3ba94fa5aa646168d9fcdb80_del 2023-11-08 22:55:34,143 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d9ef08a032246419cd7fc4e02b22083 2023-11-08 22:55:34,145 DEBUG [Listener at localhost/37975] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/.tmp/family2/1d9ef08a032246419cd7fc4e02b22083 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/1d9ef08a032246419cd7fc4e02b22083 2023-11-08 22:55:34,152 INFO [Listener at localhost/37975] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d9ef08a032246419cd7fc4e02b22083 2023-11-08 22:55:34,153 INFO [Listener at localhost/37975] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b43c07ebfd477109566f2395761640b2/family2 of b43c07ebfd477109566f2395761640b2 into 1d9ef08a032246419cd7fc4e02b22083(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-08 22:55:34,153 DEBUG [Listener at localhost/37975] regionserver.HRegion(2289): Compaction status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:34,158 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:34,163 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:34,168 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:34,169 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:34,174 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44485] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10L\x9C<\x19M\xB0\xB9\xFE8/\xDAs\xF9\xD6\x80\x91"\x10O*\x5C\xFA{\x9C\x7F\xCDW?\xE0(g\xBC\xBD\xD7*\x10vj\x11j\xBB#{\x8E\x89\x87\x7F\x00F\x1F\x0B_2\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-08 22:55:34,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-08 22:55:34,196 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-08 22:55:34,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065] to archive 2023-11-08 22:55:34,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:55:34,197 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1699484734197 2023-11-08 22:55:34,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:34,198 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-08 22:55:34,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/de23eeab87f84640bb45f7c49ded7bd8 2023-11-08 22:55:34,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/b2e91f304bdf45c7a4818b198fee5a50 2023-11-08 22:55:34,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/f387b728caf7406aa7bb227964474a08 2023-11-08 22:55:34,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/5cd81f8b3c9742339cd9dade9d72c661 2023-11-08 22:55:34,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family2/98ac574652cb4665aa1d53642043a065 2023-11-08 22:55:34,555 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-08 22:55:34,574 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del 2023-11-08 22:55:34,598 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del 2023-11-08 22:55:34,622 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del 2023-11-08 22:55:34,622 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:34,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] zookeeper.ReadOnlyZKClient(139): Connect 0x5824c572 to 127.0.0.1:56299 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-08 22:55:34,630 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b421403, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-08 22:55:34,631 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:34,773 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023110803e7c717684540cf91559619f31417ca to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110803e7c717684540cf91559619f31417ca 2023-11-08 22:55:34,774 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:34,784 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-08 22:55:34,790 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-08 22:55:34,801 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-08 22:55:34,803 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-08 22:55:34,827 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231108/family1/6da6821d327a4be28620279d0b262599 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-08 22:55:34,828 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231108/family1/6da6821d327a4be28620279d0b262599}] 2023-11-08 22:55:34,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231108/family1/6da6821d327a4be28620279d0b262599 for inclusion in d4edbc7429db0229529017da7a2dca3c/family1 2023-11-08 22:55:34,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-08 22:55:34,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first= last=1 2023-11-08 22:55:34,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:34,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231108/family1/6da6821d327a4be28620279d0b262599 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__m799v6mjr8da8ljvagnn6jm78qhbibbun5tbno5qse61p20higiatilft27ke64v/family1/6da6821d327a4be28620279d0b262599 2023-11-08 22:55:34,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__m799v6mjr8da8ljvagnn6jm78qhbibbun5tbno5qse61p20higiatilft27ke64v/family1/6da6821d327a4be28620279d0b262599 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/5e5de672e4dd459ebfdaec5666e92eaa_SeqId_28_ 2023-11-08 22:55:34,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__m799v6mjr8da8ljvagnn6jm78qhbibbun5tbno5qse61p20higiatilft27ke64v/family1/6da6821d327a4be28620279d0b262599 into d4edbc7429db0229529017da7a2dca3c/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/5e5de672e4dd459ebfdaec5666e92eaa_SeqId_28_ - updating store file list. 2023-11-08 22:55:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/5e5de672e4dd459ebfdaec5666e92eaa_SeqId_28_ into d4edbc7429db0229529017da7a2dca3c/family1 2023-11-08 22:55:34,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__m799v6mjr8da8ljvagnn6jm78qhbibbun5tbno5qse61p20higiatilft27ke64v/family1/6da6821d327a4be28620279d0b262599 into d4edbc7429db0229529017da7a2dca3c/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/family1/5e5de672e4dd459ebfdaec5666e92eaa_SeqId_28_) 2023-11-08 22:55:34,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__m799v6mjr8da8ljvagnn6jm78qhbibbun5tbno5qse61p20higiatilft27ke64v/family1/6da6821d327a4be28620279d0b262599 2023-11-08 22:55:34,873 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:34,874 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:34,875 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311082b0c1c84877e49cb96997c19bc3ff5b3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311082b0c1c84877e49cb96997c19bc3ff5b3 2023-11-08 22:55:34,876 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110841d6f62146b248559a187c65188256fe to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023110841d6f62146b248559a187c65188256fe 2023-11-08 22:55:34,877 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311084ecdfc159daa4053a25370384f78c199 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311084ecdfc159daa4053a25370384f78c199 2023-11-08 22:55:34,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108d2d58ee1bf8e4a8d9f374e770ac6560b to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108d2d58ee1bf8e4a8d9f374e770ac6560b 2023-11-08 22:55:34,878 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-08 22:55:34,878 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231108' 2023-11-08 22:55:34,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:34,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:35,005 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311082a4d8b83d7034f21a5b587f4c0fe30b2 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311082a4d8b83d7034f21a5b587f4c0fe30b2 2023-11-08 22:55:35,006 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:35,051 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231108/family1/483e6c2643c940668dc2ff28bb122bb0 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-08 22:55:35,052 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231108/family1/483e6c2643c940668dc2ff28bb122bb0}] 2023-11-08 22:55:35,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231108/family1/483e6c2643c940668dc2ff28bb122bb0 for inclusion in b43c07ebfd477109566f2395761640b2/family1 2023-11-08 22:55:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-08 22:55:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-08 22:55:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:35,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231108/family1/483e6c2643c940668dc2ff28bb122bb0 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__ht6qkbcuof0vpv8csnfhedd9q2ccf8t25m1vrc0nd67t1g6n74dku5ppditjach7/family1/483e6c2643c940668dc2ff28bb122bb0 2023-11-08 22:55:35,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__ht6qkbcuof0vpv8csnfhedd9q2ccf8t25m1vrc0nd67t1g6n74dku5ppditjach7/family1/483e6c2643c940668dc2ff28bb122bb0 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/488849bbf8f849edb7c13c6b08185869_SeqId_28_ 2023-11-08 22:55:35,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__ht6qkbcuof0vpv8csnfhedd9q2ccf8t25m1vrc0nd67t1g6n74dku5ppditjach7/family1/483e6c2643c940668dc2ff28bb122bb0 into b43c07ebfd477109566f2395761640b2/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/488849bbf8f849edb7c13c6b08185869_SeqId_28_ - updating store file list. 2023-11-08 22:55:35,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/488849bbf8f849edb7c13c6b08185869_SeqId_28_ into b43c07ebfd477109566f2395761640b2/family1 2023-11-08 22:55:35,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__ht6qkbcuof0vpv8csnfhedd9q2ccf8t25m1vrc0nd67t1g6n74dku5ppditjach7/family1/483e6c2643c940668dc2ff28bb122bb0 into b43c07ebfd477109566f2395761640b2/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/family1/488849bbf8f849edb7c13c6b08185869_SeqId_28_) 2023-11-08 22:55:35,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__ht6qkbcuof0vpv8csnfhedd9q2ccf8t25m1vrc0nd67t1g6n74dku5ppditjach7/family1/483e6c2643c940668dc2ff28bb122bb0 2023-11-08 22:55:35,107 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:35,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:35,109 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108726d90c2e52b4204955cf3e663c3b390 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108726d90c2e52b4204955cf3e663c3b390 2023-11-08 22:55:35,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110875ff406b0eaf45ae93d6e331006571b4 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110875ff406b0eaf45ae93d6e331006571b4 2023-11-08 22:55:35,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110891c6ed3d9d6d4530a5bc57c9067be1c3 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023110891c6ed3d9d6d4530a5bc57c9067be1c3 2023-11-08 22:55:35,112 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108a76f5c3ab2844358a4bb733f1ab1bfdf to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231108a76f5c3ab2844358a4bb733f1ab1bfdf 2023-11-08 22:55:35,112 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-08 22:55:35,112 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231108' 2023-11-08 22:55:35,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:35,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:36,064 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231108e969df1fd8114f78b718e75a74cfed52 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231108e969df1fd8114f78b718e75a74cfed52 2023-11-08 22:55:36,065 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:36,120 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231108/family1/639d2ab70f7d4957a2c345c7674829ef first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-08 22:55:36,121 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c., hostname=jenkins-hbase20.apache.org,35543,1699483966133, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231108/family1/639d2ab70f7d4957a2c345c7674829ef}] 2023-11-08 22:55:36,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(763): Validating hfile at hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231108/family1/639d2ab70f7d4957a2c345c7674829ef for inclusion in a8c51adf26dcd72a4fc3623a2564878c/family1 2023-11-08 22:55:36,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-08 22:55:36,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-08 22:55:36,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegion(2446): Flush status journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:36,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231108/family1/639d2ab70f7d4957a2c345c7674829ef to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__87u8afc58boqs77org0724bnpcrmucaepgdeme9q1d9maielc483pjtos7cdjcl0/family1/639d2ab70f7d4957a2c345c7674829ef 2023-11-08 22:55:36,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__87u8afc58boqs77org0724bnpcrmucaepgdeme9q1d9maielc483pjtos7cdjcl0/family1/639d2ab70f7d4957a2c345c7674829ef as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8002918b7ac44385951f739017d3e23d_SeqId_28_ 2023-11-08 22:55:36,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(849): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__87u8afc58boqs77org0724bnpcrmucaepgdeme9q1d9maielc483pjtos7cdjcl0/family1/639d2ab70f7d4957a2c345c7674829ef into a8c51adf26dcd72a4fc3623a2564878c/family1 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8002918b7ac44385951f739017d3e23d_SeqId_28_ - updating store file list. 2023-11-08 22:55:36,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(882): Loaded HFile hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8002918b7ac44385951f739017d3e23d_SeqId_28_ into a8c51adf26dcd72a4fc3623a2564878c/family1 2023-11-08 22:55:36,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.HStore(855): Successfully loaded hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__87u8afc58boqs77org0724bnpcrmucaepgdeme9q1d9maielc483pjtos7cdjcl0/family1/639d2ab70f7d4957a2c345c7674829ef into a8c51adf26dcd72a4fc3623a2564878c/family1 (new location: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/family1/8002918b7ac44385951f739017d3e23d_SeqId_28_) 2023-11-08 22:55:36,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35543] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/staging/jenkins__testMajorCompactionFromAdmin__87u8afc58boqs77org0724bnpcrmucaepgdeme9q1d9maielc483pjtos7cdjcl0/family1/639d2ab70f7d4957a2c345c7674829ef 2023-11-08 22:55:36,186 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231108 table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:36,187 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:36,188 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311080679b07e64d14026b2584b59adbcdb52 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311080679b07e64d14026b2584b59adbcdb52 2023-11-08 22:55:36,189 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311085cc4f773eea7451d83d6f18794ae1c45 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311085cc4f773eea7451d83d6f18794ae1c45 2023-11-08 22:55:36,190 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311086157befdb61640efa6899e47e5b7a991 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311086157befdb61640efa6899e47e5b7a991 2023-11-08 22:55:36,191 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231108884e7de68bfe4e9faee60746b9a51ba8 to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231108884e7de68bfe4e9faee60746b9a51ba8 2023-11-08 22:55:36,192 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-08 22:55:36,192 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231108' 2023-11-08 22:55:36,192 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231108 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:36,192 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-08 22:55:36,192 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-08 22:55:36,192 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del] 2023-11-08 22:55:36,193 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:36,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231108e5b4aa9b8aed4b07b32be74a929c9784_del 2023-11-08 22:55:36,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-08 22:55:36,195 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del] 2023-11-08 22:55:36,195 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:36,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311082251bd3b974448728d41e907f1ccdabd_del 2023-11-08 22:55:36,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-08 22:55:36,197 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] compactions.PartitionedMobCompactor(367): [hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del] 2023-11-08 22:55:36,197 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(360): Archiving compacted files. 2023-11-08 22:55:36,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del to hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311080bcc261cfe8040f4a8cd29895c373044_del 2023-11-08 22:55:36,199 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-08 22:55:36,199 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1699483970371] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-08 22:55:36,201 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-08 22:55:36,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.0060 sec 2023-11-08 22:55:36,221 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:36,224 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:36,228 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-08 22:55:36,229 DEBUG [Listener at localhost/37975] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-08 22:55:36,234 INFO [Listener at localhost/37975] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-08 22:55:36,272 INFO [Listener at localhost/37975] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 267), OpenFileDescriptor=673 (was 691), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 148) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=6265 (was 6931) 2023-11-08 22:55:36,273 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76c5615e to 127.0.0.1:56299 2023-11-08 22:55:36,273 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:36,273 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-08 22:55:36,273 INFO [Listener at localhost/37975] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-11-08 22:55:36,274 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x405f6c92 to 127.0.0.1:56299 2023-11-08 22:55:36,274 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:36,274 DEBUG [Listener at localhost/37975] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-08 22:55:36,274 DEBUG [Listener at localhost/37975] util.JVMClusterUtil(257): Found active master hash=419944526, stopped=false 2023-11-08 22:55:36,274 INFO [Listener at localhost/37975] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:55:36,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-08 22:55:36,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-08 22:55:36,275 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:55:36,275 INFO [Listener at localhost/37975] procedure2.ProcedureExecutor(628): Stopping 2023-11-08 22:55:36,275 DEBUG [Listener at localhost/37975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x307eb289 to 127.0.0.1:56299 2023-11-08 22:55:36,275 DEBUG [Listener at localhost/37975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:36,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-08 22:55:36,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-08 22:55:36,276 INFO [Listener at localhost/37975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,35543,1699483966133' ***** 2023-11-08 22:55:36,276 INFO [Listener at localhost/37975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-11-08 22:55:36,276 INFO [RS:0;jenkins-hbase20:35543] regionserver.HeapMemoryManager(220): Stopping 2023-11-08 22:55:36,276 INFO [RS:0;jenkins-hbase20:35543] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-08 22:55:36,276 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-08 22:55:36,276 INFO [RS:0;jenkins-hbase20:35543] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-08 22:55:36,276 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 7dc65429aff48ca86f09a5f4349ffb25 2023-11-08 22:55:36,277 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 4205e8d3ee75e530a59b15fc7e63f746 2023-11-08 22:55:36,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7dc65429aff48ca86f09a5f4349ffb25, disabling compactions & flushes 2023-11-08 22:55:36,277 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for de49c86467f227f556743d409603dd70 2023-11-08 22:55:36,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:55:36,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:55:36,277 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 983a597d793791ee6df1a90889470f48 2023-11-08 22:55:36,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. after waiting 0 ms 2023-11-08 22:55:36,277 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 7390e98da36ed002cdd3df703123f9e5 2023-11-08 22:55:36,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:55:36,277 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for c6cb330d61b75b359b9996b134426452 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 1c95e8c8a1ca454a69d5f71fe09e2f2f 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for be285d07f34d3de681967a49a8d0fcd2 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for aca9d12b860f784b19c77bdc5584176b 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for a8c51adf26dcd72a4fc3623a2564878c 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 2d4708da225b5f7624a58deccfe86482 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 1ba213ea03a0da8d4bf57368d963be5e 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 8c8a0a067b314367bbe438d0c388c44f 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for d4edbc7429db0229529017da7a2dca3c 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 208b1a13f3708f44bc309e7e19d8ee64 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 347fa17718a32e5504a20f4e076a1544 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for c22d0a51147f42a58be2b892dac41b50 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 5995a55ed4bc8f2b5581a5373647758b 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for b43c07ebfd477109566f2395761640b2 2023-11-08 22:55:36,278 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:36,278 DEBUG [RS:0;jenkins-hbase20:35543] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x082b9ab9 to 127.0.0.1:56299 2023-11-08 22:55:36,278 DEBUG [RS:0;jenkins-hbase20:35543] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:36,279 INFO [RS:0;jenkins-hbase20:35543] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-08 22:55:36,279 INFO [RS:0;jenkins-hbase20:35543] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-08 22:55:36,279 INFO [RS:0;jenkins-hbase20:35543] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-08 22:55:36,279 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-11-08 22:55:36,279 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-11-08 22:55:36,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-08 22:55:36,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-08 22:55:36,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-08 22:55:36,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-08 22:55:36,279 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-08 22:55:36,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-11-08 22:55:36,280 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740, 1ba213ea03a0da8d4bf57368d963be5e, 1c95e8c8a1ca454a69d5f71fe09e2f2f, 208b1a13f3708f44bc309e7e19d8ee64, 2d4708da225b5f7624a58deccfe86482, 347fa17718a32e5504a20f4e076a1544, 4205e8d3ee75e530a59b15fc7e63f746, 5995a55ed4bc8f2b5581a5373647758b, 7390e98da36ed002cdd3df703123f9e5, 7dc65429aff48ca86f09a5f4349ffb25, 8c8a0a067b314367bbe438d0c388c44f, 983a597d793791ee6df1a90889470f48, a8c51adf26dcd72a4fc3623a2564878c, aca9d12b860f784b19c77bdc5584176b, b43c07ebfd477109566f2395761640b2, be285d07f34d3de681967a49a8d0fcd2, c22d0a51147f42a58be2b892dac41b50, c6cb330d61b75b359b9996b134426452, d4edbc7429db0229529017da7a2dca3c, de49c86467f227f556743d409603dd70, dea4bbdb137840aca8ee60f38afde148 2023-11-08 22:55:36,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithMonthlyPolicy/7dc65429aff48ca86f09a5f4349ffb25/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-08 22:55:36,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7dc65429aff48ca86f09a5f4349ffb25: 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1699483982304.7dc65429aff48ca86f09a5f4349ffb25. 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4205e8d3ee75e530a59b15fc7e63f746, disabling compactions & flushes 2023-11-08 22:55:36,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. after waiting 0 ms 2023-11-08 22:55:36,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:55:36,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/4205e8d3ee75e530a59b15fc7e63f746/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-08 22:55:36,288 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:55:36,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4205e8d3ee75e530a59b15fc7e63f746: 2023-11-08 22:55:36,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1699484005735.4205e8d3ee75e530a59b15fc7e63f746. 2023-11-08 22:55:36,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing de49c86467f227f556743d409603dd70, disabling compactions & flushes 2023-11-08 22:55:36,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:55:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:55:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. after waiting 0 ms 2023-11-08 22:55:36,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:55:36,289 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-08 22:55:36,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/de49c86467f227f556743d409603dd70/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:55:36,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for de49c86467f227f556743d409603dd70: 2023-11-08 22:55:36,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1699484088426.de49c86467f227f556743d409603dd70. 2023-11-08 22:55:36,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 983a597d793791ee6df1a90889470f48, disabling compactions & flushes 2023-11-08 22:55:36,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:55:36,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:55:36,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. after waiting 0 ms 2023-11-08 22:55:36,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:55:36,295 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-08 22:55:36,298 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/983a597d793791ee6df1a90889470f48/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-08 22:55:36,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 983a597d793791ee6df1a90889470f48: 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1699484062783.983a597d793791ee6df1a90889470f48. 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7390e98da36ed002cdd3df703123f9e5, disabling compactions & flushes 2023-11-08 22:55:36,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. after waiting 0 ms 2023-11-08 22:55:36,303 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:36,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/7390e98da36ed002cdd3df703123f9e5/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7390e98da36ed002cdd3df703123f9e5: 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1699484088426.7390e98da36ed002cdd3df703123f9e5. 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing dea4bbdb137840aca8ee60f38afde148, disabling compactions & flushes 2023-11-08 22:55:36,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. after waiting 0 ms 2023-11-08 22:55:36,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:55:36,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/dea4bbdb137840aca8ee60f38afde148/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-08 22:55:36,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for dea4bbdb137840aca8ee60f38afde148: 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1699484005735.dea4bbdb137840aca8ee60f38afde148. 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c6cb330d61b75b359b9996b134426452, disabling compactions & flushes 2023-11-08 22:55:36,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. after waiting 0 ms 2023-11-08 22:55:36,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:55:36,320 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyPolicy/c6cb330d61b75b359b9996b134426452/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-08 22:55:36,321 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:55:36,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c6cb330d61b75b359b9996b134426452: 2023-11-08 22:55:36,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1699484010421.c6cb330d61b75b359b9996b134426452. 2023-11-08 22:55:36,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1c95e8c8a1ca454a69d5f71fe09e2f2f, disabling compactions & flushes 2023-11-08 22:55:36,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:36,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:36,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. after waiting 0 ms 2023-11-08 22:55:36,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:36,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/ns/testMinorCompaction/1c95e8c8a1ca454a69d5f71fe09e2f2f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1c95e8c8a1ca454a69d5f71fe09e2f2f: 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1699484088426.1c95e8c8a1ca454a69d5f71fe09e2f2f. 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing be285d07f34d3de681967a49a8d0fcd2, disabling compactions & flushes 2023-11-08 22:55:36,331 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. after waiting 0 ms 2023-11-08 22:55:36,331 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:55:36,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testScannerOnBulkLoadRefHFiles/be285d07f34d3de681967a49a8d0fcd2/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-08 22:55:36,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for be285d07f34d3de681967a49a8d0fcd2: 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1699484005735.be285d07f34d3de681967a49a8d0fcd2. 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing aca9d12b860f784b19c77bdc5584176b, disabling compactions & flushes 2023-11-08 22:55:36,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. after waiting 0 ms 2023-11-08 22:55:36,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:55:36,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/aca9d12b860f784b19c77bdc5584176b/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-08 22:55:36,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for aca9d12b860f784b19c77bdc5584176b: 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1699484062783.aca9d12b860f784b19c77bdc5584176b. 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing a8c51adf26dcd72a4fc3623a2564878c, disabling compactions & flushes 2023-11-08 22:55:36,340 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. after waiting 0 ms 2023-11-08 22:55:36,340 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:36,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/a8c51adf26dcd72a4fc3623a2564878c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for a8c51adf26dcd72a4fc3623a2564878c: 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1699484118359.a8c51adf26dcd72a4fc3623a2564878c. 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2d4708da225b5f7624a58deccfe86482, disabling compactions & flushes 2023-11-08 22:55:36,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. after waiting 0 ms 2023-11-08 22:55:36,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:55:36,345 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 2d4708da225b5f7624a58deccfe86482 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-08 22:55:36,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/.tmp/info/8621828b7114468098be54eecafe7ed6 2023-11-08 22:55:36,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/.tmp/info/8621828b7114468098be54eecafe7ed6 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/info/8621828b7114468098be54eecafe7ed6 2023-11-08 22:55:36,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/info/8621828b7114468098be54eecafe7ed6, entries=3, sequenceid=7, filesize=4.8 K 2023-11-08 22:55:36,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 2d4708da225b5f7624a58deccfe86482 in 18ms, sequenceid=7, compaction requested=false 2023-11-08 22:55:36,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/namespace/2d4708da225b5f7624a58deccfe86482/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-08 22:55:36,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2d4708da225b5f7624a58deccfe86482: 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1699483969228.2d4708da225b5f7624a58deccfe86482. 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1ba213ea03a0da8d4bf57368d963be5e, disabling compactions & flushes 2023-11-08 22:55:36,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. after waiting 0 ms 2023-11-08 22:55:36,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:55:36,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1ba213ea03a0da8d4bf57368d963be5e/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-08 22:55:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1ba213ea03a0da8d4bf57368d963be5e: 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1699484039797.1ba213ea03a0da8d4bf57368d963be5e. 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 8c8a0a067b314367bbe438d0c388c44f, disabling compactions & flushes 2023-11-08 22:55:36,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. after waiting 0 ms 2023-11-08 22:55:36,374 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:36,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithMonthlyPolicy/8c8a0a067b314367bbe438d0c388c44f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-08 22:55:36,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 8c8a0a067b314367bbe438d0c388c44f: 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1699484105727.8c8a0a067b314367bbe438d0c388c44f. 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d4edbc7429db0229529017da7a2dca3c, disabling compactions & flushes 2023-11-08 22:55:36,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. after waiting 0 ms 2023-11-08 22:55:36,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/d4edbc7429db0229529017da7a2dca3c/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d4edbc7429db0229529017da7a2dca3c: 2023-11-08 22:55:36,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1699484118359.d4edbc7429db0229529017da7a2dca3c. 2023-11-08 22:55:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 208b1a13f3708f44bc309e7e19d8ee64, disabling compactions & flushes 2023-11-08 22:55:36,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:55:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:55:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. after waiting 0 ms 2023-11-08 22:55:36,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/208b1a13f3708f44bc309e7e19d8ee64/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-08 22:55:36,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 208b1a13f3708f44bc309e7e19d8ee64: 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1699483970510.208b1a13f3708f44bc309e7e19d8ee64. 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 347fa17718a32e5504a20f4e076a1544, disabling compactions & flushes 2023-11-08 22:55:36,387 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. after waiting 0 ms 2023-11-08 22:55:36,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:55:36,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMinorCompactionWithWeeklyPolicy/347fa17718a32e5504a20f4e076a1544/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-11-08 22:55:36,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 347fa17718a32e5504a20f4e076a1544: 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1699483993260.347fa17718a32e5504a20f4e076a1544. 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c22d0a51147f42a58be2b892dac41b50, disabling compactions & flushes 2023-11-08 22:55:36,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. after waiting 0 ms 2023-11-08 22:55:36,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:55:36,394 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testCompactionWithHFileLink/c22d0a51147f42a58be2b892dac41b50/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-08 22:55:36,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c22d0a51147f42a58be2b892dac41b50: 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1699484062783.c22d0a51147f42a58be2b892dac41b50. 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5995a55ed4bc8f2b5581a5373647758b, disabling compactions & flushes 2023-11-08 22:55:36,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. after waiting 0 ms 2023-11-08 22:55:36,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:55:36,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/5995a55ed4bc8f2b5581a5373647758b/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-08 22:55:36,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5995a55ed4bc8f2b5581a5373647758b: 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1699484022851.5995a55ed4bc8f2b5581a5373647758b. 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b43c07ebfd477109566f2395761640b2, disabling compactions & flushes 2023-11-08 22:55:36,399 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. after waiting 0 ms 2023-11-08 22:55:36,399 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:36,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/default/testMajorCompactionFromAdmin/b43c07ebfd477109566f2395761640b2/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-08 22:55:36,402 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:36,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b43c07ebfd477109566f2395761640b2: 2023-11-08 22:55:36,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1699484118359.b43c07ebfd477109566f2395761640b2. 2023-11-08 22:55:36,480 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:36,596 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-08 22:55:36,596 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-08 22:55:36,680 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:36,690 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/info/3d9637e53a774bb4a39f331757556fba 2023-11-08 22:55:36,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d9637e53a774bb4a39f331757556fba 2023-11-08 22:55:36,881 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:37,081 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:37,103 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/rep_barrier/52732a792a0446368f923de9d42234b5 2023-11-08 22:55:37,112 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52732a792a0446368f923de9d42234b5 2023-11-08 22:55:37,281 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-11-08 22:55:37,281 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-11-08 22:55:37,281 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:37,482 DEBUG [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-11-08 22:55:37,519 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/table/451cf09a16f74a1e87febf19fedd6eca 2023-11-08 22:55:37,525 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 451cf09a16f74a1e87febf19fedd6eca 2023-11-08 22:55:37,525 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/info/3d9637e53a774bb4a39f331757556fba as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/info/3d9637e53a774bb4a39f331757556fba 2023-11-08 22:55:37,529 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3d9637e53a774bb4a39f331757556fba 2023-11-08 22:55:37,529 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/info/3d9637e53a774bb4a39f331757556fba, entries=226, sequenceid=130, filesize=37.9 K 2023-11-08 22:55:37,530 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/rep_barrier/52732a792a0446368f923de9d42234b5 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/rep_barrier/52732a792a0446368f923de9d42234b5 2023-11-08 22:55:37,533 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 52732a792a0446368f923de9d42234b5 2023-11-08 22:55:37,533 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/rep_barrier/52732a792a0446368f923de9d42234b5, entries=1, sequenceid=130, filesize=5.0 K 2023-11-08 22:55:37,534 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/.tmp/table/451cf09a16f74a1e87febf19fedd6eca as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/table/451cf09a16f74a1e87febf19fedd6eca 2023-11-08 22:55:37,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 451cf09a16f74a1e87febf19fedd6eca 2023-11-08 22:55:37,537 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/table/451cf09a16f74a1e87febf19fedd6eca, entries=27, sequenceid=130, filesize=6.6 K 2023-11-08 22:55:37,539 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 1260ms, sequenceid=130, compaction requested=false 2023-11-08 22:55:37,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-08 22:55:37,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-08 22:55:37,565 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-08 22:55:37,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-08 22:55:37,566 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-08 22:55:37,682 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,35543,1699483966133; all regions closed. 2023-11-08 22:55:37,690 DEBUG [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/oldWALs 2023-11-08 22:55:37,690 INFO [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35543%2C1699483966133.meta:.meta(num 1699483968946) 2023-11-08 22:55:37,696 DEBUG [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/oldWALs 2023-11-08 22:55:37,696 INFO [RS:0;jenkins-hbase20:35543] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C35543%2C1699483966133:(num 1699483968751) 2023-11-08 22:55:37,696 DEBUG [RS:0;jenkins-hbase20:35543] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:37,696 INFO [RS:0;jenkins-hbase20:35543] regionserver.LeaseManager(133): Closed leases 2023-11-08 22:55:37,696 INFO [RS:0;jenkins-hbase20:35543] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-08 22:55:37,697 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-08 22:55:37,698 INFO [RS:0;jenkins-hbase20:35543] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:35543 2023-11-08 22:55:37,705 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-08 22:55:37,705 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,35543,1699483966133 2023-11-08 22:55:37,705 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-08 22:55:37,706 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,35543,1699483966133] 2023-11-08 22:55:37,706 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,35543,1699483966133; numProcessing=1 2023-11-08 22:55:37,707 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,35543,1699483966133 already deleted, retry=false 2023-11-08 22:55:37,707 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,35543,1699483966133 expired; onlineServers=0 2023-11-08 22:55:37,707 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44485,1699483965103' ***** 2023-11-08 22:55:37,707 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-08 22:55:37,708 DEBUG [M:0;jenkins-hbase20:44485] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@583ad275, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-11-08 22:55:37,708 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44485,1699483965103 2023-11-08 22:55:37,708 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44485,1699483965103; all regions closed. 2023-11-08 22:55:37,708 DEBUG [M:0;jenkins-hbase20:44485] ipc.AbstractRpcClient(494): Stopping rpc client 2023-11-08 22:55:37,708 DEBUG [M:0;jenkins-hbase20:44485] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-08 22:55:37,708 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-08 22:55:37,708 DEBUG [M:0;jenkins-hbase20:44485] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-08 22:55:37,708 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699483968420] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1699483968420,5,FailOnTimeoutGroup] 2023-11-08 22:55:37,708 INFO [M:0;jenkins-hbase20:44485] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-08 22:55:37,708 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699483968426] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1699483968426,5,FailOnTimeoutGroup] 2023-11-08 22:55:37,708 INFO [M:0;jenkins-hbase20:44485] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-08 22:55:37,709 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-08 22:55:37,709 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-08 22:55:37,709 INFO [M:0;jenkins-hbase20:44485] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-11-08 22:55:37,709 DEBUG [M:0;jenkins-hbase20:44485] master.HMaster(1512): Stopping service threads 2023-11-08 22:55:37,709 INFO [M:0;jenkins-hbase20:44485] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-08 22:55:37,709 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-08 22:55:37,710 ERROR [M:0;jenkins-hbase20:44485] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-08 22:55:37,710 INFO [M:0;jenkins-hbase20:44485] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-08 22:55:37,711 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-08 22:55:37,712 DEBUG [M:0;jenkins-hbase20:44485] zookeeper.ZKUtil(398): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-08 22:55:37,712 WARN [M:0;jenkins-hbase20:44485] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-08 22:55:37,712 INFO [M:0;jenkins-hbase20:44485] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-08 22:55:37,712 INFO [M:0;jenkins-hbase20:44485] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-08 22:55:37,712 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-08 22:55:37,712 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:55:37,712 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:55:37,712 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-08 22:55:37,712 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:55:37,712 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.14 KB heapSize=598.98 KB 2023-11-08 22:55:37,806 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-08 22:55:37,807 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): regionserver:35543-0x101b36624920001, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-08 22:55:37,806 INFO [RS:0;jenkins-hbase20:35543] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,35543,1699483966133; zookeeper connection closed. 2023-11-08 22:55:37,807 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7fe1607d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7fe1607d 2023-11-08 22:55:37,807 INFO [Listener at localhost/37975] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-08 22:55:38,128 INFO [M:0;jenkins-hbase20:44485] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.14 KB at sequenceid=1006 (bloomFilter=true), to=hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6785b5dbb19d4be8a89c288de4350e07 2023-11-08 22:55:38,131 INFO [M:0;jenkins-hbase20:44485] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6785b5dbb19d4be8a89c288de4350e07 2023-11-08 22:55:38,132 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6785b5dbb19d4be8a89c288de4350e07 as hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6785b5dbb19d4be8a89c288de4350e07 2023-11-08 22:55:38,135 INFO [M:0;jenkins-hbase20:44485] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6785b5dbb19d4be8a89c288de4350e07 2023-11-08 22:55:38,135 INFO [M:0;jenkins-hbase20:44485] regionserver.HStore(1080): Added hdfs://localhost:45285/user/jenkins/test-data/10127467-2358-4fb0-f37a-3ff207d0e97e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6785b5dbb19d4be8a89c288de4350e07, entries=123, sequenceid=1006, filesize=33.3 K 2023-11-08 22:55:38,136 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegion(2948): Finished flush of dataSize ~513.14 KB/525460, heapSize ~598.96 KB/613336, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 424ms, sequenceid=1006, compaction requested=false 2023-11-08 22:55:38,137 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-08 22:55:38,137 DEBUG [M:0;jenkins-hbase20:44485] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-08 22:55:38,146 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-08 22:55:38,146 INFO [M:0;jenkins-hbase20:44485] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-08 22:55:38,147 INFO [M:0;jenkins-hbase20:44485] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44485 2023-11-08 22:55:38,149 DEBUG [M:0;jenkins-hbase20:44485] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,44485,1699483965103 already deleted, retry=false 2023-11-08 22:55:38,250 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-08 22:55:38,250 INFO [M:0;jenkins-hbase20:44485] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44485,1699483965103; zookeeper connection closed. 2023-11-08 22:55:38,250 DEBUG [Listener at localhost/37975-EventThread] zookeeper.ZKWatcher(600): master:44485-0x101b36624920000, quorum=127.0.0.1:56299, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-08 22:55:38,252 WARN [Listener at localhost/37975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-08 22:55:38,255 INFO [Listener at localhost/37975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-08 22:55:38,362 WARN [BP-314655194-148.251.75.209-1699483961994 heartbeating to localhost/127.0.0.1:45285] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-08 22:55:38,362 WARN [BP-314655194-148.251.75.209-1699483961994 heartbeating to localhost/127.0.0.1:45285] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-314655194-148.251.75.209-1699483961994 (Datanode Uuid b83a2e69-fd38-4d8f-af55-540546159d77) service to localhost/127.0.0.1:45285 2023-11-08 22:55:38,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/dfs/data/data1/current/BP-314655194-148.251.75.209-1699483961994] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-08 22:55:38,368 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/ae3ba8d7-66cd-c63a-5064-8452f408a050/cluster_be16c93b-3b36-0233-da7b-861169700a03/dfs/data/data2/current/BP-314655194-148.251.75.209-1699483961994] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-08 22:55:38,394 INFO [Listener at localhost/37975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-08 22:55:38,534 INFO [Listener at localhost/37975] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-08 22:55:38,662 INFO [Listener at localhost/37975] hbase.HBaseTestingUtility(1293): Minicluster is down